-- Logs begin at Sat 2022-08-06 19:52:54 UTC, end at Sat 2022-08-06 21:05:49 UTC. -- Aug 06 20:23:28.997277 dv-cinder-851996-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 06 20:23:29.004927 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 20:23:29 2022] *** Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: nodename: dv-cinder-851996-5-iscsi Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: machine: x86_64 Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: clock source: unix Aug 06 20:23:29.006899 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: pcre jit disabled Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: detected number of CPU cores: 4 Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: current working directory: / Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: detected binary path: /usr/bin/uwsgi-core Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: your processes number limit is 47680 Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: your memory page size is 4096 bytes Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: detected max file descriptor number: 2048 Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: lock engine: pthread robust mutexes Aug 06 20:23:29.007375 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: thunder lock: enabled Aug 06 20:23:29.013557 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 06 20:23:29.013557 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 20:23:29.047144 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: Python main interpreter initialized at 0x5570196a09c0 Aug 06 20:23:29.047144 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: python threads support enabled Aug 06 20:23:29.047144 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: your server socket listen backlog is limited to 100 connections Aug 06 20:23:29.047144 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: your mercy for graceful operations on workers is 90 seconds Aug 06 20:23:29.047528 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 20:23:29.047646 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: *** Operational MODE: preforking *** Aug 06 20:23:29.047924 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: *** uWSGI is running in multiple interpreter mode *** Aug 06 20:23:29.047924 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: spawned uWSGI master process (pid: 80176) Aug 06 20:23:29.048119 dv-cinder-851996-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 06 20:23:29.049459 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: spawned uWSGI worker 1 (pid: 80187, cores: 1) Aug 06 20:23:29.049459 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: spawned uWSGI worker 2 (pid: 80188, cores: 1) Aug 06 20:23:29.049459 dv-cinder-851996-5-iscsi devstack@keystone.service[80176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 20:23:34.497376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:23:34.497376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: from cryptography.utils import int_from_bytes Aug 06 20:23:34.498155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:23:34.498155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: from cryptography.utils import int_from_bytes Aug 06 20:23:34.498563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:23:34.498563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: from cryptography.utils import int_from_bytes Aug 06 20:23:34.498670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 20:23:34.498670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: from cryptography.utils import int_from_bytes Aug 06 20:23:34.546689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:23:34.546848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 20:23:34.546937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:23:34.547023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 20:23:34.547095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] command line args: [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:23:34.547163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] command line args: [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 20:23:34.547337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:23:34.547445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 20:23:34.547518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ================================================================================ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:23:34.547586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ================================================================================ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 20:23:34.547753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] admin_token = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.547881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] admin_token = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_dir = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] config_dir = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] config_source = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] debug = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] config_source = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] debug = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.548989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.549738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_config_append = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.550966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_dir = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_config_append = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_dir = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.551890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.552944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.553991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.554831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] publish_errors = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.555946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] standard_threads = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] publish_errors = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.556895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_journal = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_json = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_stderr = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.557878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] use_syslog = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] standard_threads = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.558596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.558710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.558710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.558921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.559026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.559123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.559123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] use_journal = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.559372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.559489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] use_json = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.559609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.559735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] use_stderr = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.559851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.559965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] use_syslog = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.560085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 20:23:34.560327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.560894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.561999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.562231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.562355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.562581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.562697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.562928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.563892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.564926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.565998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.566810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.567890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.568929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.569936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.570965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.571905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.572977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.573903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.574968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.575936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.576041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.576411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.576541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.576665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577584 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.577986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.578989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.579092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.579199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.579319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.579420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.582829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.583906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.584919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.585889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.586948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.external = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.587921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.password = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] auth.token = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.588875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.external = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.589981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.password = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.590918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.token = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.591927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.592879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.593993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.594947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.595923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.596758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.597896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.598895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.599993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.600945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.601647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.602908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.603986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.604916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.605930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.606986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.607945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.608911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.609977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.610928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.611902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.612997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.613885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.614930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.615936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.616993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.617931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.618998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.619959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.620896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.621959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.622962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] role.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.623959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] role.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.624895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.625945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.626995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.627973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.628907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.629972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.630914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.631990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.632934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.633924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.634993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.635888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.636956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.637929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.638990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 20:23:34.639108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 20:23:34.662775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.663000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.663179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.663282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.663430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.663650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.673022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.673262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.701049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.701463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.701551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.701687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.753417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.753787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.803546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.803774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.804728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.804967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.867948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.868972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.869053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.869192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.869408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.891613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.891838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.891922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.892925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.893005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.893169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.904392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.904729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.917525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.917723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.917809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.917955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.918891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.919020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80187) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 20:23:34.935529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.935737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:23:34.936078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.936159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.936278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:23:34.936374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:23:34.936549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.936632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.936808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 20:23:34.936888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.937838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.949213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.949490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.949754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.949840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.950031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.950128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.950312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.950594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.957783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.958438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.960868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.961153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.961436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.961527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.961716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.961798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.961998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.962877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.963933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.964203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.986488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.987153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.988020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.988299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.988691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.988976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.992894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.993175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.993455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.993607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:34.993893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:34.994180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.000060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.000345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.000817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.001103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.005017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.005263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.005544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.005781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.005863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.006926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.007056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.007183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.007494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.007774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.022782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.023059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.023837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.024122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.027099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.028153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.030254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.030549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.031348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.031648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.035489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.036614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.038641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.039894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.041890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.042190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.042475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.042765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.043957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.044241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.044521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.059876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.060159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.060433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.060698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.061177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.061474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.061747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.062014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.067613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.068979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.069186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.069435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.070545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.070827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.072271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.072545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.072845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.073134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.073413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.073663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.073951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.074255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.074552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.074832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.085146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.085425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.085703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.085979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.086255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.086528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.086800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.087263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.087547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.087830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.088114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.088398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.088678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.088955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.103994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.106189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.106939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.109172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.109890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.111487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.112340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.113607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.113889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.114178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.114705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.116353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.116649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.116934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.120631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.122240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.123406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.125042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.125177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.125466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.125745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.126016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.128026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.128320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.128606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.128886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.134180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.134562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.135006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.137177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.137494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.137777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.141963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.142249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.142527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.142801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.143072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.143383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.143685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.143953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.144335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.144616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.144696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80187) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 20:23:35.144887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.144965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.145819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.146046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.146324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.146594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.146982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.147297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.147581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.147852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.148139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.148408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80187) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 20:23:35.179387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570196a09c0 pid: 80188 (default app) Aug 06 20:23:35.182222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570196a09c0 pid: 80187 (default app) Aug 06 20:23:35.182607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300097-7a2a-4a25-b635-9057034e36b5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:35.182892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300097-7a2a-4a25-b635-9057034e36b5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:35.183157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b300097-7a2a-4a25-b635-9057034e36b5 None None] PATH_INFO: `/v3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:35.187450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Sat Aug 6 20:23:35 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:42.704197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:42.704733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:42.704733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:42.709313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:23:42.714468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:42.714889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:42.715006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:42.803941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: INFO dbcounter [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] Registered counter for database keystone Aug 06 20:23:42.822706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG oslo_db.sqlalchemy.engines [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:23:42.828999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writer thread running {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:23:43.008683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG passlib.handlers.bcrypt [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80188) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:23:43.009023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG passlib.handlers.bcrypt [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80188) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:23:43.067818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:43.069408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:43.214562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 20:23:43.361907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:43.440333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: INFO dbcounter [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] Registered counter for database keystone Aug 06 20:23:43.462845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG oslo_db.sqlalchemy.engines [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 20:23:43.469024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writer thread running {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 20:23:43.588093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daef29-2769-4aca-ac1f-56fecdeb53d2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:43.592416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:43.593035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:43.593316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:43.593591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:43.601794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:43.654926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING keystone.common.rbac_enforcer.enforcer [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:23:43.655212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166d24-0d2c-4cb7-b5f9-2aa83a713c19 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:43.664721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Aug 6 20:23:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:23:43.670724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:43.685438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77697bc9-61a8-411c-8d2e-27c411db6e34 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:43.689795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:43.691517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:43.691796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:43.692061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] PATH_INFO: `/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:43.693472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] RBAC: Authorizing `identity:get_project(project_id=2ec2c82e54624d69af0962b9e3a7a4d9)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:43.747853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 20:23:43.748425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e1b57-8a64-48fd-8f94-74b114dc99fe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:43.752825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Sat Aug 6 20:23:43 2022] GET /identity/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:45.711445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d28c2-fc30-4657-9745-3476e1c57698 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:45.711981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d28c2-fc30-4657-9745-3476e1c57698 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:45.711981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d28c2-fc30-4657-9745-3476e1c57698 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:45.716036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:45.721349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:45.722266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:45.722393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:45.743793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:45.745313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:45.752958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 20:23:45.773947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d28c2-fc30-4657-9745-3476e1c57698 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:45.786386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d28c2-fc30-4657-9745-3476e1c57698 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:45.790558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:45.791142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:45.791450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:45.791720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:45.799142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:45.801534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4d3d7-d4a8-48de-a11e-70fd8a36764e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:45.810129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Aug 6 20:23:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:23:45.816282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:45.825179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ecaf-e484-45df-84b6-3cc35d17532f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:45.829771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:45.830381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:45.830657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:45.830928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:45.832752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:45.834540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc52131-1c15-4786-99f2-8d31655f20ec admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:45.836046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Sat Aug 6 20:23:45 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:47.847169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a0be-d38d-4564-a1f9-b192b66e1520 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:47.847711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a0be-d38d-4564-a1f9-b192b66e1520 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:47.847711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95a0be-d38d-4564-a1f9-b192b66e1520 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:47.849028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:47.854238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:47.854689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:47.854775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:47.872307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:47.873466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:47.899674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e2d9-7db9-43d7-a122-d2140fdd033a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:47.899954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e2d9-7db9-43d7-a122-d2140fdd033a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:47.900218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14e2d9-7db9-43d7-a122-d2140fdd033a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:47.901511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:23:47.906490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:47.906765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:47.907032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:47.949862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG passlib.handlers.bcrypt [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80187) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 20:23:47.950286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG passlib.handlers.bcrypt [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80187) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 20:23:47.955763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:23:47.978684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:47.995881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:47.997469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:48.001523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.082224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a80a21-0080-42f2-9199-7edcc8fcd0e0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.095154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:23:48.115046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.115659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.115943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.116218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.116769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.127289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:23:48.136614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:23:48.137646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:23:48.138569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:23:48.143377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.215766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebcfd7-ee99-4529-a5c7-2915b4528dcd None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.218378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.223281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.241528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019bde9-009c-4af5-8f62-f9dfc4736374 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.255684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.256531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.256812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.257111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.274760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.275385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.275662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.275935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.276598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:48.276896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.278274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.290228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:48.295716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.324000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.325518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.426706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:23:48.432467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.435664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.501693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318607a7-5c68-4c5e-9d36-46194374a696 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.533038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af892ab6-3d20-4269-8c05-acf56609c896 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.537819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.538450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.538727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.539002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.540146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.541602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.543343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:48.548512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.562718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.570369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.571218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.571530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.571795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.591148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.593184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:23:48.612177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:23:48.613081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:23:48.613855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:23:48.613855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:23:48.613855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:23:48.613855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:23:48.618995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.652884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173f5c9-e730-4a71-a58d-107a79a1d1f5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.674122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.687266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.687843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.688118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.688392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.689498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.690968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.692715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:48.698195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:48.717303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b345-89fb-4f33-86ae-e5524ada6b5d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.750207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.750814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.751098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.751404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.752047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:48.752350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.753784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963f2d8-c5d9-4ed0-a8b0-0c3b437545f1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.770690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:48.782864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:48.809289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc506026-ac6f-4482-97fa-31ae85fb7584 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:48.845796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:48.846419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:48.846701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:48.847836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:48.848588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.domain.id=default, user.id=2fd914dd7cd747d0a7fae61653c493f6) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:48.848894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:48.850376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fb41c-0806-4230-aa20-c4f81a4331fc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:48.858021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Aug 6 20:23:48 2022] GET /identity/v3/role_assignments?user.id=2fd914dd7cd747d0a7fae61653c493f6&scope.domain.id=default&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:51.197016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921f99-c6d8-4a43-974d-c10c1a6dca5c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.198027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921f99-c6d8-4a43-974d-c10c1a6dca5c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.198500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921f99-c6d8-4a43-974d-c10c1a6dca5c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.200047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:51.205752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbf16-756f-4dc1-ad16-cecf6c4b6b2f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.206698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbf16-756f-4dc1-ad16-cecf6c4b6b2f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.206888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccbf16-756f-4dc1-ad16-cecf6c4b6b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.236250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7cccbf16-756f-4dc1-ad16-cecf6c4b6b2f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:51.237507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7cccbf16-756f-4dc1-ad16-cecf6c4b6b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:51.264280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd166-a904-4899-88c6-f78e5af2275c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.264890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd166-a904-4899-88c6-f78e5af2275c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.265692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbd166-a904-4899-88c6-f78e5af2275c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.267383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 12/23] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:23:51.276772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.277341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.277781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.307642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:51.309186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:51.332209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:51.354105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d769d-9433-4731-ba3b-12439ad38b3b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.354685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d769d-9433-4731-ba3b-12439ad38b3b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.355164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d769d-9433-4731-ba3b-12439ad38b3b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.356718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 13/25] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:23:51.361946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.362487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.362991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.381351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:51.382824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:51.413513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:23:51.414457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:51.455499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:51.457262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:51.466065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:51.498186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:51.591298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f664f0-9690-41ff-a8ab-d2bcc9029020 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:51.632743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:51.633706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.634173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.634627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.646527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:51.648274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:23:51.664299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:23:51.665204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:23:51.665968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:23:51.665968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:23:51.665968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:23:51.667101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ac86f-19c3-40d7-be08-d7a49355bba0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:51.667968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 15/28] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:23:51.668914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:51.728890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:51.741266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:51.741999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.742281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.742554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.764606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:23:51.771168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:23:51.772024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:23:51.772762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 14/29] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:23:51.773848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:51.785273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d517f9-5f62-4a8f-8919-95f0887de1dd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:51.821220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:51.822204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.822690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.823144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.824046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:51.825639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45813dba-9401-48b9-9363-cdf5a86a7f0e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:51.957915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 16/30] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 20:23:51 2022] POST /identity/v3/roles => generated 225 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:23:51.967591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1c1-f675-4e1f-a86b-ad3173a3d15c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:51.968208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1c1-f675-4e1f-a86b-ad3173a3d15c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:51.968694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b1c1-f675-4e1f-a86b-ad3173a3d15c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:51.970313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 17/31] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:51.971285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b1c1-f675-4e1f-a86b-ad3173a3d15c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.041945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439703e4-e941-4dea-ab77-9b52eb1acb1f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.053265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.105866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55b1c1-f675-4e1f-a86b-ad3173a3d15c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.127647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.136820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.137452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.137744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.138018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.138678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:52.138980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.140408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412f3f5-e368-4b45-ae37-e4d0fa7150df None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.153389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.154366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.154835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.155336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.156899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:52.157400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.160462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.164675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 15/32] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:52.165942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.166226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.166498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.171102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 18/33] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:23:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:52.172209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.216363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:52.217589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:52.305619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f90b77-4f4e-4cec-b5cf-e1eee743142a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.308597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 16/34] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:52.310026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.354199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.355557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.356039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.356781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.357895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.359615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b3fb0-682b-4903-9d5c-cd2eacdfbe1d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.397442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 19/35] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/projects => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:23:52.403670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab0aa-2d94-437c-b8ce-1ee742f6a7b1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.404034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab0aa-2d94-437c-b8ce-1ee742f6a7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.404379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab0aa-2d94-437c-b8ce-1ee742f6a7b1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.407064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 20/36] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:52.407899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab0aa-2d94-437c-b8ce-1ee742f6a7b1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.424574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.435752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f6348-213a-4161-b15e-fc0080370f8d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.456818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.498422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.499510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.500014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.500479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.503148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.505020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a52341-2e85-4fd5-9530-1eb366ed9030 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.507536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 17/37] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:23:52 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:52.508901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.509316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.509722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.535605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:52.537789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:52.574618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab0aa-2d94-437c-b8ce-1ee742f6a7b1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.628179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.628783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.629077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.629333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.629997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.631438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.644576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 18/38] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:52.645423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.656939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 21/39] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/roles => generated 219 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:23:52.673434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.778492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.785792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:52.788809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0020e79-1c9b-4fae-94d2-7cfbf3d11f90 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.795881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094b085-629a-4f56-a84f-31cb9e97b25c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.830836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.832020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.832298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.832567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.833693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.835143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b59e7-25ff-48e3-a16a-cb59a3571924 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.836744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 19/40] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:52.838011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186393a6-813c-4231-ac97-9c0b9ca34d40 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.838412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186393a6-813c-4231-ac97-9c0b9ca34d40 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.838694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186393a6-813c-4231-ac97-9c0b9ca34d40 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.842408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:52.843025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.843330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.843604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.844202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 20/41] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:52.844300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:52.844918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186393a6-813c-4231-ac97-9c0b9ca34d40 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:52.845907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e35fc-c714-4d72-ba22-520527cd3f65 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:52.867293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:23:52.868870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:52.869159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:52.869431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:52.890698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:52.894222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:52.978548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186393a6-813c-4231-ac97-9c0b9ca34d40 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:52.983143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:53.006042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:53.020042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:53.020816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:53.021102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:53.021378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] PATH_INFO: `/v3/domains/default/users/2fd914dd7cd747d0a7fae61653c493f6/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:53.023413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2fd914dd7cd747d0a7fae61653c493f6, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:53.024870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:53.099002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:53.118725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d56d-eefa-4a42-9146-1a9ad4469208 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:53.144947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 21/44] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Aug 6 20:23:52 2022] PUT /identity/v3/domains/default/users/2fd914dd7cd747d0a7fae61653c493f6/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:23:53.152028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:53.152686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:53.152965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:53.153236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:53.154396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:53.155916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec559-7149-4b28-babc-36c0dcda662a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:53.157533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 24/45] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:53.164043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:53.191709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:53.274604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b62df-b4a9-4d07-83dd-643a90e3b9ee None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:53.310781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:53.311434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:53.311713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:53.311984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:53.312627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:53.314270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8f25c-3414-4e8c-b207-1aadd593bbb7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:53.346582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:23:53 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:23:55.120783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740923-b57b-4a95-8fee-9be8c5957ea7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.121289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740923-b57b-4a95-8fee-9be8c5957ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.121369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740923-b57b-4a95-8fee-9be8c5957ea7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.122669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:55.127935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993258-8563-4f6f-8908-f7d23ba3b8e4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.128873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993258-8563-4f6f-8908-f7d23ba3b8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.129096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993258-8563-4f6f-8908-f7d23ba3b8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.146940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-86993258-8563-4f6f-8908-f7d23ba3b8e4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:55.148482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-86993258-8563-4f6f-8908-f7d23ba3b8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:55.217060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:55.241123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740923-b57b-4a95-8fee-9be8c5957ea7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.312024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b57b7-2bab-44a5-9915-11119b782fb9 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.312320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b57b7-2bab-44a5-9915-11119b782fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.312600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b57b7-2bab-44a5-9915-11119b782fb9 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.313954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 24/49] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:23:55.319172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.319490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.319771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.326904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:55.340311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:55.341496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:55.345972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740923-b57b-4a95-8fee-9be8c5957ea7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.380385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.380946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.381232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.381507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.391723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:23:55.397107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:23:55.398052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:23:55.399486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 26/50] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:23:55.404173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.410138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 25/51] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:23:55.417556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:55.431884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.505795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565df4c-60c5-4d15-9719-1f3a9b89dcc1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.527232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee8b2-4b59-4983-955a-1e89f847cb2c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.538774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.539405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.539682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.539951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.540602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:55.540899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.542280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:55.550724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 27/52] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:55.556191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.561202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.561825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.562107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.562380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.563511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.564955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:55.567196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:55.572860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.575526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:55.625276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:55.656683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4d29-dd6d-4761-81be-c948fa720af7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.671685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0704-9d71-44e9-8d5e-a1133f7b5a1f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.689596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.690223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.690548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.691349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.692492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.693941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:55.695550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 28/54] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:55.700901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.705949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.706572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.706850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.707114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.707789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.709210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:55.735786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 27/55] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Aug 6 20:23:55 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:23:55.807179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131444c-882c-4c47-8ffc-f43efa3a5f9a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.842358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.843015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.843328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.843607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.844778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.846271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7c556-3c19-4b30-945d-d966ed5edaaf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:55.848189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:23:55.856130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:55.914293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:55.959313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba07e161-57c6-41c0-8797-354d0598b65f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:55.992729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:55.993332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:55.993615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:55.993888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:55.994609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.domain.id=default, user.id=2fd914dd7cd747d0a7fae61653c493f6) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:23:55.994914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:55.996395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a1f82-0b27-4e26-b4e5-5af3f4afd139 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:56.004314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Aug 6 20:23:55 2022] GET /identity/v3/role_assignments?user.id=2fd914dd7cd747d0a7fae61653c493f6&scope.domain.id=default&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:57.710252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deb8a-f648-4336-95ee-d0066060848d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:57.710763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deb8a-f648-4336-95ee-d0066060848d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:57.710849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2deb8a-f648-4336-95ee-d0066060848d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:57.712149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:23:57.717117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:57.717555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:57.717676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:57.736180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:23:57.737364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:23:57.801184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:23:57.823610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2deb8a-f648-4336-95ee-d0066060848d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:57.833419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:57.924354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2deb8a-f648-4336-95ee-d0066060848d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:57.955871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:57.957011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:57.957290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:57.957563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:57.958651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:57.960129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962ee44-2f3e-4289-8a9b-f14810a9b79b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:57.961659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:23:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:23:57.967178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:23:58.021789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:23:58.070481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca0cf-537c-407b-8849-f10d007697c9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:23:58.103890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:23:58.104482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:23:58.104764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:23:58.105038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:23:58.105677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:23:58.107124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7997515-5ee0-4bfb-b97e-a864223fdf93 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:23:58.134943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:23:57 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:01.112121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0fc5-6180-44e7-beb8-296b2029ab4e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.113002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0fc5-6180-44e7-beb8-296b2029ab4e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.113423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0fc5-6180-44e7-beb8-296b2029ab4e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.114935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:01.120562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.120967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.121197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.148305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:01.149545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:01.203753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92e81-9ec1-43e9-991a-c477e73c2732 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.204505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92e81-9ec1-43e9-991a-c477e73c2732 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.204983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b92e81-9ec1-43e9-991a-c477e73c2732 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.206520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 33/63] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:01.211938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.212467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.212952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.232794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:01.240263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:01.241472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:01.299824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.356318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.369448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:01.398664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.403586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.439390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1976-6188-4c70-bda6-5a0644e39dea None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.481977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:01.481977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.481977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.481977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.504145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:01.508987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:01.509972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:01.510730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 32/66] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:01.520584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.556329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71c6b0-a6ce-427a-b54f-e5d3fc25ef09 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.602793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:01.603692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.604160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.604614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.616578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-854e147a-69c4-440a-a22d-381e8f7fe0e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:01.622012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:01.622818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:01.623604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:01.624510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 35/67] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:01.627329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92348-4ed5-4379-a142-04007ce91425 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.627329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92348-4ed5-4379-a142-04007ce91425 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.627329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92348-4ed5-4379-a142-04007ce91425 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.629963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 36/68] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:01.631530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92348-4ed5-4379-a142-04007ce91425 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.691660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.699416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.701117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d8f4c-58bd-454c-b0af-5c6bad842755 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.739677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:01.740284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.740567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.740838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.741503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:01.741675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92348-4ed5-4379-a142-04007ce91425 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.741829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:01.743187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8710720-23e9-436a-b896-45135c3b4f2a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:01.756176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 33/69] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:01.757826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.758203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.758556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.777791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:01.779226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:01.780387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:01.780998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.781279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.781549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.782214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:01.782512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:01.783926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c75153-a67b-4a91-abe9-807726b32895 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:01.791949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 37/70] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:01.793084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf87-4d86-44ff-a068-0550930b6ae4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.793368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf87-4d86-44ff-a068-0550930b6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.793641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3bf87-4d86-44ff-a068-0550930b6ae4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.799227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 38/71] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:01.799227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3bf87-4d86-44ff-a068-0550930b6ae4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.859190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 34/72] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:01.860090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:01.904576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3bf87-4d86-44ff-a068-0550930b6ae4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.933789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.943623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:01.944261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.944541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.944819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.958198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:01.959021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:01.960982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede9145-b909-43a9-ae00-3caac876eb05 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:01.962675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 39/73] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:01.963966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff16f-d66c-4f5a-9b1e-46ad32006a0a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:01.964248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff16f-d66c-4f5a-9b1e-46ad32006a0a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:01.964522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff16f-d66c-4f5a-9b1e-46ad32006a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:01.974060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505c86-9485-44b8-8686-81e5f03089ec None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:01.981922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-616ff16f-d66c-4f5a-9b1e-46ad32006a0a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:01.983112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-616ff16f-d66c-4f5a-9b1e-46ad32006a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:02.007219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.007874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.008153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.008428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.009549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.010994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.012591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 35/74] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:01 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:02.013338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.052389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 40/75] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:02.053677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4c7b-ac23-40b1-a21a-eb6dfe81b54a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.053971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4c7b-ac23-40b1-a21a-eb6dfe81b54a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.054245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f4c7b-ac23-40b1-a21a-eb6dfe81b54a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.055674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 41/76] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:02.056327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f4c7b-ac23-40b1-a21a-eb6dfe81b54a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.122393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14d059-afa1-47ee-9024-4e805a29cb7b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.154429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.155120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.155364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.155637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.158927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f4c7b-ac23-40b1-a21a-eb6dfe81b54a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.170177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:02.173638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:02.176687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:02.177525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:02.178257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 36/77] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:02.178865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.195129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.195782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.196062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.196335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.198494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.263699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.265170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9caf6a-52ba-42bf-809b-5e81088c138d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.282147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8c63c-661c-4d4e-9cc0-156eb5e782af None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.314603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.315196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.315501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.315769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.364347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 42/78] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:02.365641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.365930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.366201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.380305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.381760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.383096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:02.384297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:02.393260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.396218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.450523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 43/79] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:02.451284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.479617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 37/80] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:02.480628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.551738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973e88-0c7d-4649-8a6d-c4708770ef4e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.578054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230392ad-7e07-43fa-bfdd-d2a1d46026a2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.586783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.587444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.587720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.587993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.589088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.590516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.592128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 44/81] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:02.592878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.598523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.610115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.620210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.620816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.621085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.621362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.622024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:02.622327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.623737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.631324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 38/82] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:02.636462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.696772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88cb6-7440-497a-b4ac-951bbcd6a4e7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.730215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.730773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.731052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.731480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.732593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.734045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.734891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b0d7-8c7a-4e55-954f-6d58a26a33c1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.735698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 45/83] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:02.736453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.768556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.769250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.770039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.770302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.780397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:02.786062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:02.786882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:02.787646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 39/84] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:02.788273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.819587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.825906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:02.848147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2af9ad-4b2b-48e9-a798-0558e56d84b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.881939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.882570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.882848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.883121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.884259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.885713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.887351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 46/85] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:02.888101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:02.895272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b62b7-6baf-448c-bd4b-0979d532cd39 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:02.927709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:02.928304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:02.928578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:02.928843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:02.929478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:02.930902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:02.952783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 40/86] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:02 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:02.953584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.004264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c721a1-96c2-4d7a-96be-df1f53868829 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.053547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.054438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.054858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.055301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.057124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.058777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.060326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.065636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 47/87] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:03.066779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.073061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce4d7-e67b-4152-8aa3-d355147af69d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.088583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.115488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.116710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.116710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.116899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.118122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:03.118122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.119846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.126392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 41/88] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:02 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=471bd621e24848afa89853237208e118 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:03.127402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.197346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23af1e-4de7-4bee-b604-3cc0bed4e91e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.250107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.250824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.251163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.251486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.252218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:03.252531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.254682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.265207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 48/89] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:03.271026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.286723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d694642-0001-45fa-865e-b94a58f8cbe3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.340302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.340917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.341195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.341464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.342192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=2fd914dd7cd747d0a7fae61653c493f6) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:03.342499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.343978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.350705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 42/90] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/role_assignments?user.id=2fd914dd7cd747d0a7fae61653c493f6&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:03.351558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.394599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.419009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.439723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3efbfe-1aaf-4ace-adac-3107f4a766c1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.518201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.519000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.519349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.519621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.621925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21369e-5bb3-4a3e-9987-06518d8ae76b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.661685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.661903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.662778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.663291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.663522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.664003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:03.665599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:03.667439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:03.674369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 43/91] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:03.676132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.834009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.863649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:03.873472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 49/92] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:03.883727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8b26e-e99b-442f-892c-43714b274737 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:03.886116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:03.948280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:03.948943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:03.949229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:03.949505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:04.103280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491afc25-59e6-425b-ac8e-e2846ad02335 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:04.111436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:04.111436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:04.162849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:04.163873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:04.164374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:04.164836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:04.167637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:04.169309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:04.171137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 50/93] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:04.177680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:04.251419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:04.319273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:04.330158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc987-8df9-4afb-b116-506c4155c7e4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:04.345702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 44/94] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:04.351050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:04.375034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:04.375953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:04.376428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:04.376891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:04.377803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:04.378352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:04.380643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:04.386328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 51/95] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:04 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:04.513531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a16004-3d5e-4b15-9c75-64ce476bb3d3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:04.554363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:04.555031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:04.555343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:04.555620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] PATH_INFO: `/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:04.556908 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=55f0ec653b1c476dbf3dcb817cfeef32)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:04.558720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2fe71-abce-40ca-9a02-97249db0f1b5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:04.561239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 45/96] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:04 2022] GET /identity/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:04.568969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:04.733757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314c0c-4805-480a-988a-592c6c79a094 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:04.747544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:04.776141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:04.776760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:04.777039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:04.777310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:04.778048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=55f0ec653b1c476dbf3dcb817cfeef32, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:04.778364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:04.779946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ca04c-0257-4679-aa59-8f14313c7b95 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:04.792240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 52/97] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:04 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=55f0ec653b1c476dbf3dcb817cfeef32&role.id=471bd621e24848afa89853237208e118 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:05.691190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57daf1-0388-4dd6-97be-5abc4e1787d4 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:05.691739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57daf1-0388-4dd6-97be-5abc4e1787d4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:05.691813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57daf1-0388-4dd6-97be-5abc4e1787d4 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:05.693447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 46/98] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:05.704685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b497-13be-4a9e-97ff-17dacd146aeb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:05.705137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b497-13be-4a9e-97ff-17dacd146aeb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:05.705220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b497-13be-4a9e-97ff-17dacd146aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:05.725673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fe76b497-13be-4a9e-97ff-17dacd146aeb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:05.726883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fe76b497-13be-4a9e-97ff-17dacd146aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:05.813781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 53/99] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:05.847783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57daf1-0388-4dd6-97be-5abc4e1787d4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:05.922004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:05.935785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd4d-8436-4c3e-b649-6bd8647801ee None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:05.936368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd4d-8436-4c3e-b649-6bd8647801ee None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:05.936964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aacd4d-8436-4c3e-b649-6bd8647801ee None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:05.938696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 54/100] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:05.952709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:05.953319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:05.953800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:05.983597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:05.985274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:06.000998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57daf1-0388-4dd6-97be-5abc4e1787d4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.085020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.085688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.085928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.086201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.115514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:06.120260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:06.121055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:06.122282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:06.123286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 55/101] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:06.123357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 47/102] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:06.127149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.154353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.199672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:06.329445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb97b-ca48-4d65-9a62-54dffd3a7ce1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.352473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6cbce-5895-4efc-8478-3b63e341134b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.383131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:06.405756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.406387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.406669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.406944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.407651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:06.407954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:06.409343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c205-f7a1-4caf-bb9e-ff9bc1ce4674 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:06.419199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.419966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.420325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.420667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.421868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:06.423426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698a39-7b3b-4936-a60c-0bc6d17fdff2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:06.424250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 56/103] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:06.426070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 48/104] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:06.426390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c15d-1826-4729-aec9-407568b03eba None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.426865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c15d-1826-4729-aec9-407568b03eba None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.427332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c15d-1826-4729-aec9-407568b03eba None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.427606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6e0e-f4b9-450c-86b6-972966224fd3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.427960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6e0e-f4b9-450c-86b6-972966224fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.428308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc6e0e-f4b9-450c-86b6-972966224fd3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.429276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 57/105] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:06.430265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c15d-1826-4729-aec9-407568b03eba None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.430375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 49/106] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:06.436906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc6e0e-f4b9-450c-86b6-972966224fd3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.534075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:06.541825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c15d-1826-4729-aec9-407568b03eba None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.559624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc6e0e-f4b9-450c-86b6-972966224fd3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.576446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.577081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.577359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.577881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.584313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:06.586288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162e7f1-4322-4f8d-8392-64de3dcbc85d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:06.592597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 58/107] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:06 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:06.592597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.592597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.592597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.605579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.606428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.606904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.607432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.608294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:06.609956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ee3de-93f5-4b3d-b4f7-eec3fd2afefa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:06.616907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:06.618218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:06.639306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 50/108] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:24:06 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:06.640888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.641335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.641814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.678128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:06.680409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:06.742476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:06.765214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 59/109] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:06.766730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.810500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 51/110] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:06.811757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:06.940446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:06.942293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf86b84-df4d-4fa3-809d-c6ee573776d5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.950765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daf412-41ed-4901-ac2e-d084f36aafca None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:06.985298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:06.986088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:06.986435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:06.986781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:06.999576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:07.001423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.002250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.002723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.003165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.005115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:07.005580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:07.006435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:07.007634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 52/111] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:07.008420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.009933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.012238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 60/112] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:06 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:07.014341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.044795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:07.174204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8192d-ef56-4646-9633-7ba5527c6394 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.193627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a3725-b8df-4a31-9b2a-72ab395ef1fb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.235514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.236209 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.236491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.236766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.253330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:07.258128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:07.258952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 53/113] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:07.260114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.268856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.269798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.270279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.270557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.271262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:07.271589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.273100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.290432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 61/114] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:07.291304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.339609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:07.432157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:07.463618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23eddb-ccf5-4f7c-b7a5-3feddde1ef01 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.466603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8892fd3-0c60-434f-80f3-edd32296fa35 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.503484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.504217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.504501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.504866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/users/0f3a400d92614fb78543a24ca95ef1c4/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.506811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, user_id=0f3a400d92614fb78543a24ca95ef1c4, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.507357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.508219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.508347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.508838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.509301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.510301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:07.511045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.513479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71561e5-5de4-47c5-a828-c88e6b84429f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.523931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 54/115] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:07 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/users/0f3a400d92614fb78543a24ca95ef1c4/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:07.524609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.526104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 62/116] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:07.527632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376774b2-0dfe-4e25-bdad-334fd938fa71 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.528082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376774b2-0dfe-4e25-bdad-334fd938fa71 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.528511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376774b2-0dfe-4e25-bdad-334fd938fa71 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.530041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 63/117] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:07.536583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.537121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.537822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.585380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:07.586681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:07.667635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 64/118] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:07.668697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.683163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9ba7d-df4e-48c1-8008-4741f9051714 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.705102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:07.732929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.733811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.734985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.735286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.736449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.737893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1081e-bce2-4454-9ed2-b7978a5c4caf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.739550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 55/119] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:07.741197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b39c-a798-4262-bae8-c78ca901a92d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.741476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b39c-a798-4262-bae8-c78ca901a92d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.741744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425b39c-a798-4262-bae8-c78ca901a92d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.747704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 56/120] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:07.749302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425b39c-a798-4262-bae8-c78ca901a92d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.767724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:07.821367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d90f54-dec8-4e3c-94ab-6854883c2621 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.858519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425b39c-a798-4262-bae8-c78ca901a92d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:07.859585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.860374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.860651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.861021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] PATH_INFO: `/v3/users/c7ba523537d94ceb8971d8fcdb707826` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.877111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] RBAC: Authorizing `identity:get_user(user_id=c7ba523537d94ceb8971d8fcdb707826)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:07.878766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4beaaa-10dd-4c09-a9ea-25823537968f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:07.880765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 65/121] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/users/c7ba523537d94ceb8971d8fcdb707826 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:07.881741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.882088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.882407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.895360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:07.896003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:07.896282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:07.896554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:07.902324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:07.903650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:07.907137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:07.912536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:07.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 57/122] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:07.916730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.992352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 66/123] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:07.993342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:07.997021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.006987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.034752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8c6f-360e-49df-8a82-a740187d135d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.070558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.071200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.071547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.071822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.072960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.074415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.076308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 58/124] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:08.076977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.139836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f39cdd-a12d-4b6a-a949-e30f90f7be0f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.186642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.187275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.187840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.188150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.198832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984d31f-9844-4d4e-9a42-8f32ca50f941 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.235957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.236574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.236855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.237171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.237832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:08.238167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.239666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.248977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 59/125] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:08.249583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.258312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.286388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.288776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.292370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.374977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb9ab8-a5c9-492d-a9fc-f8da2c334315 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.410504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.411264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.411657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.412107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.416177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 67/126] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:08.417357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.423849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:08.433309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:08.434325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:08.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:08.436975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 60/127] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:08.442615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.509455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.549842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec08744-b3c1-4324-8e18-cca2b30e4711 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.553373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.558781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf50e-017f-4e09-bd05-51ecff9252df None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.594505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.595190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.596654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.597181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/users/2fd914dd7cd747d0a7fae61653c493f6/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.601939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, user_id=2fd914dd7cd747d0a7fae61653c493f6, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.603424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.604293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.605184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.605768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.606235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.607842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.610733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.614167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 61/128] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:08.615335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.631277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 68/129] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:08 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/users/2fd914dd7cd747d0a7fae61653c493f6/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:08.635783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.834223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e3195-4396-4599-969a-dc2616586629 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.852121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd37f94-6c58-4d05-b9ed-19f0e3460fc4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:08.870741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:08.880488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.881377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.882354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.882832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.884702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.887075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.890365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 62/130] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:08.892087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.897532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:08.897532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:08.897808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:08.898179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:08.898918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:08.899302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:08.900771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:08.911338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 69/131] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:08.912166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:08.949630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.017247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86844611-a585-4acd-8ff2-5740cad121a3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.038635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbd6f-19dd-428c-b553-8990a4a3b068 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.056796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.057210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.057543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.057823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.058940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.060429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.062252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 63/132] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:09.062883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.076135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.077090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.077835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.078301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.079223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=c7ba523537d94ceb8971d8fcdb707826) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:09.079770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.081459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90f45c-56a0-4687-888b-43f49b95e659 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.087933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 70/133] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:08 2022] GET /identity/v3/role_assignments?user.id=c7ba523537d94ceb8971d8fcdb707826&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:09.089542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77792bef-118a-492a-ac15-64fe137075cb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.090025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77792bef-118a-492a-ac15-64fe137075cb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.090547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77792bef-118a-492a-ac15-64fe137075cb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 71/134] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:09.093136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77792bef-118a-492a-ac15-64fe137075cb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.141172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.178978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7fcca-fece-4159-8d7c-7b61f38ff155 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.216326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.217235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.217696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.218106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.219482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.221200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220fc448-d874-4aac-b1c5-1145bfd2ad49 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.223691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 64/135] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:09 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:09.225123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.225608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.226158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.260843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:09.263821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:09.273849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.295685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77792bef-118a-492a-ac15-64fe137075cb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.350392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.350989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.351303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.351564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/users/0f3a400d92614fb78543a24ca95ef1c4/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.353844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, user_id=0f3a400d92614fb78543a24ca95ef1c4, role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.355505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.369916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 65/136] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:09.371155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.379497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 72/137] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:09 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/users/0f3a400d92614fb78543a24ca95ef1c4/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:09.468126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.479284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.537429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d138445-82c5-4116-bf1f-f539670329ef None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.611784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.612537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.612817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.613886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] PATH_INFO: `/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.616233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=55f0ec653b1c476dbf3dcb817cfeef32)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.617716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.620631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 66/138] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:09 2022] GET /identity/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32 => generated 312 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:09.626372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.676667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23a6d0-cb9e-4f4c-97ce-1a275feee947 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.718650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.719323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.719607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.719881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.721618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.724049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.726176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 73/139] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:09.731628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:09.758540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.800621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aee09b-6ae0-48de-84e3-dd6821f7cfa9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.841761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.842512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.842753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.843032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] PATH_INFO: `/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32/users/0f3a400d92614fb78543a24ca95ef1c4/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.845938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] RBAC: Authorizing `identity:create_grant(project_id=55f0ec653b1c476dbf3dcb817cfeef32, user_id=0f3a400d92614fb78543a24ca95ef1c4, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.848373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc5a76-5df3-49b5-8f32-7da76c7f7a86 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.851796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:09.874297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a4b1d2-872d-441e-922c-5e405af5567b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:09.878173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 67/140] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:09 2022] PUT /identity/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32/users/0f3a400d92614fb78543a24ca95ef1c4/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:09.879302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1527d-c367-4ab9-b2be-0d0c7ce5ef97 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.879592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1527d-c367-4ab9-b2be-0d0c7ce5ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.879865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1527d-c367-4ab9-b2be-0d0c7ce5ef97 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.884340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 68/141] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:09.898827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.899156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.899428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.931028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:09.935104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:09.935712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:09.936178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:09.937181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:09.940070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:09.941069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:09.942939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:10.017769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 74/142] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:09 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:10.046304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 69/143] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:10.102493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:10.214025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:10.248536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30709e-3356-4aab-82b2-242abc2f0ece None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:10.291087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:10.291780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:10.292055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:10.292321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:10.305121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:10.310611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:10.312997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:10.314034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 75/144] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:10.319167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:10.433481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9474-a8ab-4467-a062-10f9899d7e5f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:10.459270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:10.473382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:10.473993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:10.474268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:10.474533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:10.475194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:10.475521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:10.476892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:10.489554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 70/145] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:10.495100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:10.613188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d20f-5227-45f1-88c3-73d344ae0827 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:10.651037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:10.651709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:10.651984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:10.652259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:10.653401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:10.654872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:10.656602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 76/146] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:10 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:10.662414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:10.773619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9311c-5902-48a9-ba75-76367d6aebdf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:10.816557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:10.817555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:10.818030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:10.818494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:10.887271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:10.901762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:10.903608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:11.005700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 71/147] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:11.016385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:11.020099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:11.173216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e25488-f289-416c-9ce3-9492bda3d5c5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:11.213889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:11.214543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.214824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.215098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.216276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:11.217742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e92c38-2e10-4671-8c11-ad2eb84d46d0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:11.219708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 77/148] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:11 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:11.225666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:11.351485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:11.368849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e09e0c-ac62-49dd-be3d-5253b0e216f0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:11.409241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:11.410809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.411339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.411802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.412731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:11.413247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:11.414887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ff5a4-fcb4-4cbb-9ec3-bbfd4b241888 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:11.427462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 72/149] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:11 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=471bd621e24848afa89853237208e118 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:11.874527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c22bf-c547-431e-9a3a-76f3b25b12aa None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.874900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c22bf-c547-431e-9a3a-76f3b25b12aa None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.875093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c22bf-c547-431e-9a3a-76f3b25b12aa None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.876473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 78/150] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:11.888724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.889644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.890108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.913799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:11.915350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:11.940768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e81f-3c87-46b1-a5eb-7e2ca0ea174d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.941901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e81f-3c87-46b1-a5eb-7e2ca0ea174d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.942363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502e81f-3c87-46b1-a5eb-7e2ca0ea174d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.943953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 79/151] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:11.962375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:11.962967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:11.963449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:11.999867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:12.002533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:12.041692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 73/152] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:12.067557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.147693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:12.163373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 80/153] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:12.197995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.199911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:12.209064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d029451-c0ea-4fc1-b29d-cc17a8908828 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:12.284087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:12.285143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.285619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.286107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.318066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:12.323185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:12.324028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:12.324765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:12.327306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 74/154] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:12.333698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.399102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da22d10-82ed-40b3-8e14-a43eb92dd9fe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:12.454072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:12.454072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.454072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.454072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.470657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:12.476192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:12.477012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:12.477971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 81/155] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:12.485873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.575908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:12.597260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec282-5f6e-41e5-8878-1938580d71aa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:12.643843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dbe5e-3d45-4aad-bb9e-6838b1196420 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:12.699021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:12.699874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.700285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.700688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.701518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:12.701991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:12.703802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:12.708063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:12.708920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.709756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.710152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.710942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:12.711396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:12.712907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:12.723955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 82/156] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:12.729561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 75/157] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:12.730428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.748627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:12.757578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:12.894139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cf3bb-8806-4c59-86c0-d4068db605b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:12.923616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:12.949325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:12.950174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.950588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.950988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] PATH_INFO: `/v3/users/2fd914dd7cd747d0a7fae61653c493f6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.955902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] RBAC: Authorizing `identity:get_user(user_id=2fd914dd7cd747d0a7fae61653c493f6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:12.958050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a1592-5685-4d98-b636-710220ef7e57 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:12.960135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 83/158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/users/2fd914dd7cd747d0a7fae61653c493f6 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:12.961501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b200-ef2c-4f58-85a2-3794893dfa6f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:12.961914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b200-ef2c-4f58-85a2-3794893dfa6f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:12.962336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b200-ef2c-4f58-85a2-3794893dfa6f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:12.963700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 84/159] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:12.966120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b200-ef2c-4f58-85a2-3794893dfa6f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.013374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506234-b965-4d1e-9bff-c31505ff5d7c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:13.092941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:13.093926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.094358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.094780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] PATH_INFO: `/v3/users/c7ba523537d94ceb8971d8fcdb707826` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.096174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c7ba523537d94ceb8971d8fcdb707826)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:13.097803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122a5e-b283-48fe-920f-570a6b1329c8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:13.107970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 76/160] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/users/c7ba523537d94ceb8971d8fcdb707826 => generated 289 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:13.109366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.109801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.110212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.136325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:13.137756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:13.162525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b200-ef2c-4f58-85a2-3794893dfa6f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:13.232116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:13.232653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.233104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.233534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.288574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:13.296563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 77/161] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:13.297646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.346493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:13.367173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:13.368687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef906d-6720-4fc3-8f26-2daec2b780e1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:13.449199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6ddfc-5fde-409e-a148-81d6de6f6f6d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:13.489933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:13.490500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.490775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.491041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.493625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:13.495110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd7732-df40-4df6-8668-0e4cb2291ce1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:13.498181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 78/162] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:13 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:13.500150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b88bd-335b-4028-b4b9-05a3a70009c8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.500430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b88bd-335b-4028-b4b9-05a3a70009c8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.500699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b88bd-335b-4028-b4b9-05a3a70009c8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.501955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 79/163] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:13.505484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b88bd-335b-4028-b4b9-05a3a70009c8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.569293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 85/164] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:24:13.576561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.576843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.577111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.613442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:13.614625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:13.625441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:13.677531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b88bd-335b-4028-b4b9-05a3a70009c8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:13.716849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:13.717799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.718223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.718637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.735901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 86/165] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:13.736970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.741674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:13.747855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:13.748944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:13.749775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:13.756610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 80/166] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:13.759427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.786660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:13.876511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793fc5a-e9a9-4927-8c14-36582007b013 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:13.904222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:13.916790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:13.917679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:13.918098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:13.918515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:13.920529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:13.922100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:13.924567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 81/167] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:13 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:13.930453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:13.948088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac8ef8-0d11-4805-ab06-fe18a6e6829f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.026866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.027938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.028431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.028913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/users/c7ba523537d94ceb8971d8fcdb707826/roles/fb967ae279174a67b6758588dc9f7ec2` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.033129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, user_id=c7ba523537d94ceb8971d8fcdb707826, role_id=fb967ae279174a67b6758588dc9f7ec2)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.034922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.057714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 87/168] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:13 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/users/c7ba523537d94ceb8971d8fcdb707826/roles/fb967ae279174a67b6758588dc9f7ec2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:14.058987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.115175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b0507-32c8-4be3-842c-85a787830816 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.161391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.162411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.162892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.164402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.165567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:14.167533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.169243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.186635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 82/169] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:14.188666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.255979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:14.258652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:14.289971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbdca2-8d0b-4f88-88bb-7e618493d526 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.346130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062185a-136c-45a2-8221-3b189432a30d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.369538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.370552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.371029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.371523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.392864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8951c8dc-815e-46fe-b714-7a7ed85a3ed9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:14.397976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:14.398852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:14.399635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:14.402694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 88/170] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:14.410052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff27457-35cb-4539-b10b-e285c3584659 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.410348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff27457-35cb-4539-b10b-e285c3584659 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.410609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff27457-35cb-4539-b10b-e285c3584659 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.412575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 89/171] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:14.414897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff27457-35cb-4539-b10b-e285c3584659 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.421159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.422105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.422581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.423064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.424031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=2fd914dd7cd747d0a7fae61653c493f6) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:14.424543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.426794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.440786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 83/172] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/role_assignments?user.id=2fd914dd7cd747d0a7fae61653c493f6&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:14.442539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.546250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff27457-35cb-4539-b10b-e285c3584659 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.585809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.586403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.586679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.586945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.588158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.589651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c55e47-db0c-4760-ac43-11e0e4b7817d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.595311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 90/173] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:14.595311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece508-98ca-4850-b80b-a2319797de4d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.595311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece508-98ca-4850-b80b-a2319797de4d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.595311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ece508-98ca-4850-b80b-a2319797de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.616808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-63ece508-98ca-4850-b80b-a2319797de4d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:14.618004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63ece508-98ca-4850-b80b-a2319797de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:14.620208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:14.646715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a6fe1-a487-4b4d-9ee5-6bf41c05897a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.689778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.690386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.690655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.690922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.692297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:14.692598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.693965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc79ac-9f40-4d06-8b12-a78d36fc1c7f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.695606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:14.696677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:14.697979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ea5f-1856-4314-ac5d-2fe544597826 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.698323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ea5f-1856-4314-ac5d-2fe544597826 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.698598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ea5f-1856-4314-ac5d-2fe544597826 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.700039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 92/175] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:14.700555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ea5f-1856-4314-ac5d-2fe544597826 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.710817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 84/176] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:14.712220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.712499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.712863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.745956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:14.747144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:14.827006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:14.832537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:14.846559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ea5f-1856-4314-ac5d-2fe544597826 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.883982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:14.884600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:14.884876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:14.885142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:14.893757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:14.959714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:14.961334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5a3b1-7e93-45b1-8322-f5dd27250294 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:14.962827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec9b1-4c5a-43bd-a7e5-46f88ab86a50 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:14.981059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.002528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.003156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.003463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.004257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] PATH_INFO: `/v3/users/0f3a400d92614fb78543a24ca95ef1c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.005733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] RBAC: Authorizing `identity:get_user(user_id=0f3a400d92614fb78543a24ca95ef1c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.007165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.011383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 86/178] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/users/0f3a400d92614fb78543a24ca95ef1c4 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.011383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.076372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:15.078245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c18e-ba23-4303-a0e2-aca964631a1a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.078664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c18e-ba23-4303-a0e2-aca964631a1a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.079075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81c18e-ba23-4303-a0e2-aca964631a1a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.080453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 94/180] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:15.085578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81c18e-ba23-4303-a0e2-aca964631a1a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.128516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.139021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a06c-4110-4328-ab01-207c436a0247 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.181465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.182097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.182361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.182627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.197056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:15.201828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81c18e-ba23-4303-a0e2-aca964631a1a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:15.201960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:15.202751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:15.203799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:15.208508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 87/181] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:15.209348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.244066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.244820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.245100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.245368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.257780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:15.258493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:15.264945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:15.265814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:15.266569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:15.269318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 95/182] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:15.270514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.326650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dacdff-854a-402a-963e-6327cb008232 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.367288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.367830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.368110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.368377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.387637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.391434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60542a8e-b9c9-4e68-9681-36024410dfff None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.428184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.428809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.429329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.429329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.430502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.431939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64f346-280a-4a8b-ac1c-e66ab8d8cd68 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.433576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 96/183] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.434811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.435094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.435522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.442738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.443588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.453149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:15.454327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:15.487829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.523291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 97/184] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:15.536143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.548421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 88/185] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:15.549526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.644225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.652361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e45c5-470e-48a3-ba83-2add22338379 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.659191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dce3e-013e-455a-9af6-86171d8509ca None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.699357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.700177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.700484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.700754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.701439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:15.701767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.703429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.706459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.707340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.707823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.708292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.709705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:15.710203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.711964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.712802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 98/186] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.713215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.725696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 89/187] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.726605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.730963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.823776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000d769-1c84-4294-8c0a-fe49dbad12fc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.830685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686ce6d-59fb-47bf-a9ea-e1a2e4c3c12b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:15.860111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.860791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.861062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.861334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.862049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:15.862414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.863845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.865278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:15.865909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:15.866187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:15.866454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:15.867630 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:15.869079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:15.870185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 99/188] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.870746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 90/189] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:15.871426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.880508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:15.913144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:15.965520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.004794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f52497-9a4f-4b66-9aa8-1d56a639a3ce None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.026631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488da31e-887b-4804-8c2d-11bf6177c177 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.053134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.054171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.054638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.055157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.077206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.078213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.078461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.078559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.078753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] PATH_INFO: `/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.080132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] RBAC: Authorizing `identity:get_project(project_id=55f0ec653b1c476dbf3dcb817cfeef32)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.080243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.081343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.085931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 91/190] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:16.085931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.086142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 100/191] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:15 2022] GET /identity/v3/projects/55f0ec653b1c476dbf3dcb817cfeef32 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:16.086142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.201874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b48e-9fa8-4226-bcb9-1f9408edb47a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.204513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.215197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e31302-68fe-4659-a9b9-cc96cb1ccd46 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.236936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.244094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.244732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.245006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.245270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.246388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.247847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.249420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 92/192] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:16.250168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.251566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.252177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.252458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.252728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.253364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.255300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.277444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 101/193] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:16 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:16.278086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.376812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d158fec-43d6-4760-8f53-03240b769630 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.392023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda7434-5b57-4a5b-bfd7-dea8e4e5133d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.418087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.418704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.418980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.419259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.419987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=55f0ec653b1c476dbf3dcb817cfeef32, user.id=0f3a400d92614fb78543a24ca95ef1c4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:16.420293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.421734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c638c-b8ab-48ad-abde-3c078a6beb4a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.429695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 93/194] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/role_assignments?user.id=0f3a400d92614fb78543a24ca95ef1c4&scope.project.id=55f0ec653b1c476dbf3dcb817cfeef32&role.id=471bd621e24848afa89853237208e118 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:16.432530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.432662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed01d3-d590-4ec7-979a-4c67b9639cd2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.432828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed01d3-d590-4ec7-979a-4c67b9639cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.433148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.433252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed01d3-d590-4ec7-979a-4c67b9639cd2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.433425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.433693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.434522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 94/195] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:16.435345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed01d3-d590-4ec7-979a-4c67b9639cd2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.453187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.520717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.525972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.527586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae47d8-373b-4a9d-a4ab-5cc3a9ff9d9d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.586933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed01d3-d590-4ec7-979a-4c67b9639cd2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.635104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.636058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.636532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.636992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.680405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 102/196] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:16.682027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.682312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.682647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.703549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:16.705080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:16.722837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.724827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.762473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.792814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 103/197] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:16.793720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.825784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:16.864684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 95/198] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:16.865441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.924291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abe5bf-cd4c-4132-ba83-0ca100f17ad1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:16.961944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:16.962504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:16.962783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:16.963055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:16.964294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:16.965858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:16.967963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 104/199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:16.968959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:16.974287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed94c94-375e-4ca2-a1bb-e70be16602c9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.011505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.012138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.012415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.012682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.020126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:17.025045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:17.030435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:17.031334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:17.032094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 96/200] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:17.033748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:17.061470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:17.094212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501895f-f30f-41e1-a431-6a7981fedc9a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.144646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.146215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.147046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.147420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.149151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.151504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:17.154407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 105/201] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:16 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:17.155040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:17.160960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee97b96-838f-461c-8fb1-e7cb6b571140 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.197906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.198640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.198988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.199368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.200221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=903579ad8a5d4683b3c064994c8bdbb4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:17.200594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.202154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:17.209802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 97/202] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:17 2022] GET /identity/v3/role_assignments?user.id=903579ad8a5d4683b3c064994c8bdbb4&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:17.210795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:17.317857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979943-70e0-4421-a9bc-b04a45792122 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.349766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:17.377038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:17.401396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.402006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.402276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.402536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.403189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:17.403538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.404887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:17.410474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209151-87c9-4df4-b1d5-99efd91565fd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.420151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 106/203] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:17.426717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:17.482254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.482917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.483189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.483559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.484194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=903579ad8a5d4683b3c064994c8bdbb4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:17.484496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.485989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:17.503270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 98/204] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:17 2022] GET /identity/v3/role_assignments?user.id=903579ad8a5d4683b3c064994c8bdbb4&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:17.558945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f6671-5ae0-4794-aa31-3a3235634616 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.611442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.612094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.612368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.612633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] PATH_INFO: `/v3/users/c7ba523537d94ceb8971d8fcdb707826` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.616746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] RBAC: Authorizing `identity:get_user(user_id=c7ba523537d94ceb8971d8fcdb707826)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.618223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:17.620250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 107/205] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:17 2022] GET /identity/v3/users/c7ba523537d94ceb8971d8fcdb707826 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:17.625757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:17.755393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e746852-c42d-41c8-bd62-761137130c27 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:17.802830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:17.803476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:17.803751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:17.804016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:17.828658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:17.893338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:17.895323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:18.026514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 99/206] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:18.031595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:18.110743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:18.200900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23017767-3908-4ac3-8748-1f3dbff922fa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:18.250685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:18.251349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.251633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.251905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.255921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:18.257383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bf8f6-4d8e-4f61-bad3-4337cab3529b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:18.259187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 108/207] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:18 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:18.268340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:18.350683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:18.423802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad17492-e1eb-4892-9f2a-3b80524ff560 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:18.477417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:18.477944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.478221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.478487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.479213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, scope.project.id=542dcebbf30642e39296c8926a46b61a, user.id=c7ba523537d94ceb8971d8fcdb707826) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:18.479544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:18.480990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a09ce-e770-4dd4-bcb2-790b612bc301 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:18.492348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 100/208] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:18 2022] GET /identity/v3/role_assignments?user.id=c7ba523537d94ceb8971d8fcdb707826&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:18.745561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aea32-cd7f-4f1e-90b5-a08d0ebc7647 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.746547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aea32-cd7f-4f1e-90b5-a08d0ebc7647 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.747045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156aea32-cd7f-4f1e-90b5-a08d0ebc7647 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.748619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 109/209] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:18.753918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709960-f904-458c-8d6d-c5122adc2845 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.754206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709960-f904-458c-8d6d-c5122adc2845 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.754479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf709960-f904-458c-8d6d-c5122adc2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.775651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bf709960-f904-458c-8d6d-c5122adc2845 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:18.776832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bf709960-f904-458c-8d6d-c5122adc2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:18.860495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 101/210] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:18.882747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aea32-cd7f-4f1e-90b5-a08d0ebc7647 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:18.884140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d296ec-b5b7-47e1-8d4a-f95f0f003742 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.884425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d296ec-b5b7-47e1-8d4a-f95f0f003742 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.884696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d296ec-b5b7-47e1-8d4a-f95f0f003742 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.886045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 102/211] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:18.890997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:18.891403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:18.891683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:18.911150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:18.912534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:18.960087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:18.992325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 103/212] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:19.015932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.025311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156aea32-cd7f-4f1e-90b5-a08d0ebc7647 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.040914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.074108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.074751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.075030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.075339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.087472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:19.092239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:19.093103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:19.093868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 110/213] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:19.099781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.137878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb296-2b60-4061-8048-7c438145dc0b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.173459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.174419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.174907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.175499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.176810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.178426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.184851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 104/214] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:19.185908 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.204108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6501b-cb16-4b60-96e8-25ba45015ded None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.231717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.240953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.241694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.241882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.242124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.242862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:19.243192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.244860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.254306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 111/215] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:19.259930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.295096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.297389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb86b0-104f-488f-b238-654f2842b3db None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.334624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.335593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.336062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.336608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.337459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.339080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.363475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 105/216] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:19 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:19.374315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf2c28-6e73-4a42-8960-0fb1e4800d11 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.414894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.415583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.415862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.416158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] PATH_INFO: `/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.432699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a4567bc1249bba7a0cb31b71a0c68)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.434205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005a83-ce1b-4a14-8cd1-7ed4f49efb01 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.436412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 112/217] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:19.442981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.553313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.557455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a07131-afbe-4732-bb4e-bb2936000d4b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.591899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a88a-905b-418e-9bea-4811f9d389ea None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.592086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a88a-905b-418e-9bea-4811f9d389ea None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.592325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a88a-905b-418e-9bea-4811f9d389ea None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.593674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 113/218] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:19.600437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.600711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.600981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.607741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.608365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.608650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.609921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.622680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:19.624257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:19.692520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.694154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.715616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 114/219] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:19.744339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.777191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.819449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:19.824595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 106/220] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:19.830380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.882630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a45a21-701c-49de-98e2-6872bf5eaa00 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.921650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.922575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.922909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.923186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.936734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa788-1f20-4354-86b3-d5717e5b7890 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:19.937061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:19.943575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:19.944648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:19.945601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:19.950103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 115/221] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:19.951370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:19.979951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:19.980834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:19.981250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:19.981683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:19.983000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:19.984758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:19.986825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 107/222] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:19.993005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.056330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.083604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05e8df-f16a-4a8b-9959-3cd09a02498a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.083866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.115002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0456ce-0aae-4b9e-ba69-626600534640 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.120227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.120995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.121391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.121760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.122581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:20.122982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.124515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb1768-1640-42bd-ac87-564dd2f07569 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.140996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 116/223] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:20.140996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814dd9-4cbc-4e96-877f-98e946a5affb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.140996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814dd9-4cbc-4e96-877f-98e946a5affb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.140996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af814dd9-4cbc-4e96-877f-98e946a5affb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.140996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 117/224] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:20.147957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.148483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.148963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.166829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.167844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.168125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.168393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.168672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:20.169120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=2c7a4567bc1249bba7a0cb31b71a0c68) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:20.169422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.170713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:20.170887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.178087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 108/225] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:19 2022] GET /identity/v3/role_assignments?user.id=2c7a4567bc1249bba7a0cb31b71a0c68&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=471bd621e24848afa89853237208e118 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:20.179001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.255582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 118/226] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:20.278362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.302238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf34c88-9893-4299-a601-ecf6778dacd2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.364084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.377107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.377760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.378035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.378306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.380382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.381836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.387415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 109/227] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:20.392121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.410908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.470297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eada5-cb8d-418e-8999-244a0d67c847 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.536534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.537175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.537449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.537716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.558845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3339f9e-3deb-4441-9214-3de584c32283 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.562313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:20.571716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:20.572581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:20.573330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:20.577736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 119/228] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:20.581140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.629957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.630512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.630787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.631059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.632397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.633831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.635478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 110/229] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:20.641492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.719560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc27de-b1d5-4819-a3df-73685c72b5b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.750020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.755910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.756524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.756800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.757069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.757742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:20.758041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.759452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.768516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 120/230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:20.776250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:20.778558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:20.818664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fbc05-7cd1-4b84-bf8c-b5704e30878f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.856370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.857037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.857316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.857583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/903579ad8a5d4683b3c064994c8bdbb4/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.859534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, user_id=903579ad8a5d4683b3c064994c8bdbb4, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.861094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.877147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 111/231] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:20 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/903579ad8a5d4683b3c064994c8bdbb4/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:20.905063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56fae7-a766-44ec-9e72-bce34dabd255 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:20.945755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:20.946499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:20.946782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:20.947052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:20.948268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:20.949825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:20.952611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 121/232] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:20.958866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:21.114368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3a8d-e3f7-4d74-b4bd-ee681cf00664 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:21.142938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:21.155685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:21.156574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:21.157041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:21.157526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:21.158839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:21.161165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed15453-cbcb-4a13-9d72-b6c7306f54eb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:21.163323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 112/233] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:20 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:21.168875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:21.250368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:21.298097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b2020-e838-45fe-93bd-68b6c08074ee None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:21.343920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:21.344959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:21.345446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:21.345904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/903579ad8a5d4683b3c064994c8bdbb4/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:21.348560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, user_id=903579ad8a5d4683b3c064994c8bdbb4, role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:21.350214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca760b43-b6ae-4284-aaf2-c95868ef4910 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:21.370522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 122/234] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:21 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/903579ad8a5d4683b3c064994c8bdbb4/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:22.151594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265621-b5fa-4fe0-97f4-c97b6c9eb49e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.152587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265621-b5fa-4fe0-97f4-c97b6c9eb49e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.153097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265621-b5fa-4fe0-97f4-c97b6c9eb49e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.154639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 113/235] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:22.160538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.161345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.161805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.170171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c32f6-0a46-47c4-9856-cd6f60912649 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.170766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c32f6-0a46-47c4-9856-cd6f60912649 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.171268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c32f6-0a46-47c4-9856-cd6f60912649 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.172820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 114/236] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:22.178252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a377-51ae-4e17-9319-e68984853286 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.178789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a377-51ae-4e17-9319-e68984853286 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.179311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936a377-51ae-4e17-9319-e68984853286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.187947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:22.188432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:22.200223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1936a377-51ae-4e17-9319-e68984853286 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:22.201751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1936a377-51ae-4e17-9319-e68984853286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:22.279352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 115/237] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:22.309471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 123/238] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:22.328963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a377-51ae-4e17-9319-e68984853286 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:22.367986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:22.449446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:22.454371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936a377-51ae-4e17-9319-e68984853286 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:22.479611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:22.498636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:22.499291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.499573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.499839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.502245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:22.504275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:22.506963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 116/239] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:22.513771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:22.537539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de4aec-749d-425c-a30b-4ae23368ffa4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:22.631953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:22.632839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.633250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.633648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.644672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29641121-4e4d-410c-8593-38118aabad8f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:22.677605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:22.679597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:22.680363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.680781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.681211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.682002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:22.682455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:22.683517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:22.684472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:22.686265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e41c6f-c024-462f-9295-b70d3f44e27d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:22.689613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 124/240] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:22.700560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:22.712435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 117/241] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:22 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:22.738952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0c6c-2367-49d4-bfd7-9d2d245ae00a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.739337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0c6c-2367-49d4-bfd7-9d2d245ae00a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.739528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de0c6c-2367-49d4-bfd7-9d2d245ae00a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.740994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 118/242] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:22.749024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.749324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.749574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.792152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:22.793756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:22.851690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:22.880595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 119/243] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:22.903223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:22.907700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37faa92-0562-4aa5-956f-995ea79eab63 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:22.930070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:22.977637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:22.978276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:22.978549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:22.978813 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:22.979541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:22.979837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:22.981338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:22.994458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 125/244] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:23.004830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.031040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6af12d-d930-41d3-9747-8ab8e1216f54 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.094447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.095077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.095459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.095837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.110084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:23.115299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:23.116194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:23.117203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 120/245] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:23.122393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.155190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c60e8-6bc6-441a-ba3c-fa86c9732108 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.180107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.214069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.214712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.214981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.215269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] PATH_INFO: `/v3/users/d58db031639d4de8bd3158887fae9026` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.234635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d58db031639d4de8bd3158887fae9026)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:23.236673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:23.240953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 126/246] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/users/d58db031639d4de8bd3158887fae9026 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:23.244853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.264258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5022f-1f57-4ea2-8da2-a492f3730107 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.289837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.313036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.313646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.313921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.314188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.314854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:23.315147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:23.317138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ceedf-b71f-4afd-b695-6789d6b9c94f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:23.325873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 121/247] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:23.326910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354ceb-0d36-4652-8ff2-9d145461be16 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.327192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354ceb-0d36-4652-8ff2-9d145461be16 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.327579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354ceb-0d36-4652-8ff2-9d145461be16 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.329036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 122/248] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:23.333888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354ceb-0d36-4652-8ff2-9d145461be16 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.372542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d2070-32fd-4211-a96d-b72b61a8e8b5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.408669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.409513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.410008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.410408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.465208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.471277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354ceb-0d36-4652-8ff2-9d145461be16 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.489837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:23.491614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:23.526977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb493494-869e-465c-81a0-7192495f549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.528222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493494-869e-465c-81a0-7192495f549c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.528934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493494-869e-465c-81a0-7192495f549c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.530007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb493494-869e-465c-81a0-7192495f549c None admin] PATH_INFO: `/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.531675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb493494-869e-465c-81a0-7192495f549c None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a4567bc1249bba7a0cb31b71a0c68)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:23.534960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb493494-869e-465c-81a0-7192495f549c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:23.537820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.538545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 123/249] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:23.543096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.543397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.543663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.575773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:23.580095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:23.667790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 127/250] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:24:23.668715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.707370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 124/251] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:23.708027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.841695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f1e1-af16-4a5a-bd31-b582b9c19932 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:23.894833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:23.895501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:23.895778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:23.896065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:23.897636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:23.898130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.900907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:23.902782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 128/252] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:23.903350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:23.907534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:23.917214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46638d-bbb0-44f2-9a09-115ae4385f0f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.009688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387065c3-6675-4513-9633-45e0881afc4e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.023964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.024621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.024904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.025179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.031927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:24.033376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:24.035277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 125/253] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:24.035897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.044876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.045556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.045831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.046149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.058090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:24.071608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:24.072503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:24.073268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 129/254] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:24.073893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.151170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098710e-57d7-41a8-95e3-b25b7859e476 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.179617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:24.196327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.197524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.198367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.198782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/2c7a4567bc1249bba7a0cb31b71a0c68/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.201634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, user_id=2c7a4567bc1249bba7a0cb31b71a0c68, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:24.203906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:24.210098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823c5b6-fa8d-4a91-b752-d455ca6fb7dc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.220024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 126/255] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:24 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/2c7a4567bc1249bba7a0cb31b71a0c68/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:24.221507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.265558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:24.296119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.298800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.299138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.299451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.300209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=d58db031639d4de8bd3158887fae9026) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:24.301056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:24.305674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13994f7c-c2b9-45ed-b5d4-a8bc35a57057 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:24.322368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 130/256] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/role_assignments?user.id=d58db031639d4de8bd3158887fae9026&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:24.324013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee97c-2ff2-4eb2-9f32-551949267330 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.324324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee97c-2ff2-4eb2-9f32-551949267330 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.324634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ee97c-2ff2-4eb2-9f32-551949267330 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.329719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 131/257] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:24.333732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.334051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.334341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.377281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:24.378520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:24.422248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd963-9999-4435-8e44-9240005ffc87 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.461989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.462613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.462890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.463160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.463942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:24.464247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:24.465730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:24.477353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 127/258] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:24.484735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.507875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 132/259] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:24.534691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.642497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:24.654056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:24.663015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39216fe2-b1db-42cd-a527-db2dec50375b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.702709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.703550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.703827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.704092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.705683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:24.707600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:24.709493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 128/260] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:24.714794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.757159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9edbca-31e9-45df-8cba-d0ebd955f24f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.835552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.836251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.836532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.836800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:24.863816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:24.865675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607cf11-8cdc-468c-9cc4-6fdad61deb4d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:24.868598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:24.869533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:24.870295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:24.875571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 133/261] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:24.876520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:24.948949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:24.949910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:24.950388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:24.950893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.012844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.069210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3aa72-0594-490d-9a66-76c82467edee None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:25.103541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.105190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.106885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.158089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:25.158705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.158974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.159235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.160537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:25.160836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.162227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.175944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 134/262] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:25.182058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:25.289944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a64e-3785-4ea9-8307-7ae60d004952 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:25.332557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:25.333177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.333451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.333718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] PATH_INFO: `/v3/users/903579ad8a5d4683b3c064994c8bdbb4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.334274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 129/263] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:24:25.334869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] RBAC: Authorizing `identity:get_user(user_id=903579ad8a5d4683b3c064994c8bdbb4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.336359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.338948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:25.340861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 135/264] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:25 2022] GET /identity/v3/users/903579ad8a5d4683b3c064994c8bdbb4 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:25.349519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:25.459066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.466683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.572263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f6a1e-a359-4569-9d5b-d7dca975c35d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:25.594537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a53b90-8665-462e-93a1-a58aef7d801c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:25.657418 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:25.658051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.658321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.658585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.659763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.661217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61404f26-d0eb-4b2f-b984-41d1b9bf194b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.662835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 130/265] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:25 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:25.664010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668b4-c42d-4427-9a2a-6c344671f036 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.665089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668b4-c42d-4427-9a2a-6c344671f036 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.667593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668b4-c42d-4427-9a2a-6c344671f036 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.669384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 131/266] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:25.671505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:25.672317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.672728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.673131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.674389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249668b4-c42d-4427-9a2a-6c344671f036 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:25.749877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.751651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ceb70-11ab-40a0-88e3-164cdb036f61 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.798701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.856257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249668b4-c42d-4427-9a2a-6c344671f036 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:25.911080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 136/267] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:25.911294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:25.914012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100676-26aa-4a4b-9fed-e137a6a355e4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.914510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100676-26aa-4a4b-9fed-e137a6a355e4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.915085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100676-26aa-4a4b-9fed-e137a6a355e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.936342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:25.937235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:25.937678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:25.938080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:25.938936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=903579ad8a5d4683b3c064994c8bdbb4) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:25.939399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:25.941650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:25.948655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 132/268] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:25 2022] GET /identity/v3/role_assignments?user.id=903579ad8a5d4683b3c064994c8bdbb4&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:25.949679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:25.952555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-01100676-26aa-4a4b-9fed-e137a6a355e4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:25.955094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-01100676-26aa-4a4b-9fed-e137a6a355e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:26.098404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 137/269] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:26.103887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e244-8fef-40c4-be5a-390864feebe0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.104799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e244-8fef-40c4-be5a-390864feebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.105418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6e244-8fef-40c4-be5a-390864feebe0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.108853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 138/270] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:26.114443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.114908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.115342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.144376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:26.145909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:26.148433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e1214-3686-485f-84a2-53305fbfd77e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.186793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.188268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.188655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.189025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.190261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.191857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.193968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 133/271] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:25 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:26.194818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.221218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 139/272] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:26.222784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.226376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.263030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.311423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e5ef-bb7c-4c59-81a6-c15c2e588773 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.341025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79490e-3f30-414f-ae13-3fe4b0bbd82f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.346816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.348546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.349002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.349414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.360177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:26.365203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:26.366077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:26.366839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:26.369420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 134/273] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:26.370435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.379809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.380501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.380875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.381482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.382055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=903579ad8a5d4683b3c064994c8bdbb4) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:26.382423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.384237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.390654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 140/274] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/role_assignments?user.id=903579ad8a5d4683b3c064994c8bdbb4&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:26.392533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.482303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a0aed-ff83-4d57-bb94-b0494c220126 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.486117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.501767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.521786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.522827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.523362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.524458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.527875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.529804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.531930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 135/275] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:26.537954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.558812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c4ef-29d8-44ed-92a1-c8e0089fa872 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.654062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.655088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.655641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.656122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.657410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:26.657721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.659108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.669523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 141/276] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:26.677805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.732568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6129b4-816d-4107-97a2-572b847e93c0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.780731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.781742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.782020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.782671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.784353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.812051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 136/277] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:26 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:26.821926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d024ab1-b347-4c4b-9f46-0ee47fc19c79 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:26.859442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.866905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:26.867890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.868344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.868801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] PATH_INFO: `/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.885708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] RBAC: Authorizing `identity:get_user(user_id=f3d6a2a8f0ff4ddb8fd3fdc786e68895)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:26.887525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac4516-8a7f-4c9d-a93b-978d5c2425ff None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:26.889861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 142/278] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:26.896193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:26.924903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4408-2c1f-43ec-8643-9d16bd4512a3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.925201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4408-2c1f-43ec-8643-9d16bd4512a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.925460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb4408-2c1f-43ec-8643-9d16bd4512a3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.927731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 143/279] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:26.937966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20913-e21c-465d-bb04-8aac68108d1d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:26.938303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20913-e21c-465d-bb04-8aac68108d1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:26.938586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20913-e21c-465d-bb04-8aac68108d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:26.960902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:26.967824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-59d20913-e21c-465d-bb04-8aac68108d1d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:26.969604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-59d20913-e21c-465d-bb04-8aac68108d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:27.040687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75db44-34b7-41fb-9f63-3c9f56bbd535 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.060392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 144/280] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:27.068392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963485-e0f2-4621-aff5-5dd6b0ad43bc None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.068723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963485-e0f2-4621-aff5-5dd6b0ad43bc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.069025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7963485-e0f2-4621-aff5-5dd6b0ad43bc None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.070498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 145/281] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:27.076769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e497e-a941-4d9f-908c-328590baa640 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.077079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e497e-a941-4d9f-908c-328590baa640 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.077377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e497e-a941-4d9f-908c-328590baa640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.081629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.082993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.083519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.083986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.085160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, user.id=f3d6a2a8f0ff4ddb8fd3fdc786e68895, scope.system=all) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:27.087603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.089290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.096001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 137/282] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 20:24:26 2022] GET /identity/v3/role_assignments?user.id=f3d6a2a8f0ff4ddb8fd3fdc786e68895&scope.system=all&role.id=471bd621e24848afa89853237208e118 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:27.096839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.098947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-224e497e-a941-4d9f-908c-328590baa640 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:27.100192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-224e497e-a941-4d9f-908c-328590baa640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:27.200064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 146/283] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:27.234183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e497e-a941-4d9f-908c-328590baa640 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.242065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15db57c-3a43-4eed-bacb-52567c419bba None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.245745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:27.282761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.283419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.283692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.283958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.296785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:27.299845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:27.304354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:27.305237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:27.306010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:27.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 138/284] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:27.312933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.355588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e497e-a941-4d9f-908c-328590baa640 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.392597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.393235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.393507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.393772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.404527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:27.409216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:27.411695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:27.413034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 147/285] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:27.419280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.424282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d2108-c17d-4149-9fc0-e1f8dbd069ff None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.489393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.489879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.490432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.490700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.491485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:27.491783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.493385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.510822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 139/286] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:27.517253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.539970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585884b2-e4cc-41f4-92c3-508d82b67e09 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.548803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:27.553887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:27.608382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.608862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.609140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.609408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.610082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:27.610381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.611804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.634622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 148/287] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:27.649575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d97fd-b285-4571-902c-37f3c420bd8a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.656649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.687337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.688319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.688815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.689866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] PATH_INFO: `/v3/users/d58db031639d4de8bd3158887fae9026` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.691357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] RBAC: Authorizing `identity:get_user(user_id=d58db031639d4de8bd3158887fae9026)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.693167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.695349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 140/288] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/users/d58db031639d4de8bd3158887fae9026 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:27.700465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.802014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:27.814951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2d009-852e-4680-adf4-fa3546a0107c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.891892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.892887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.893362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.893825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.895876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.897793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.906388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 141/289] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:27.911679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:27.933625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae790bd-641a-49a5-b974-c73d1034cb4d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:27.982199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:27.983336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:27.983950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:27.985220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] PATH_INFO: `/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:27.986611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] RBAC: Authorizing `identity:get_user(user_id=2c7a4567bc1249bba7a0cb31b71a0c68)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:27.988345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:27.991120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 149/290] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/users/2c7a4567bc1249bba7a0cb31b71a0c68 => generated 297 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:27.996839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:28.049840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:28.053890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf78e65-0f80-4b2b-aa21-0b07b6c34bcc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:28.118324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606028c-9b69-47b3-98b3-49397759056c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:28.160752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:28.161664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:28.162181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:28.162558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:28.187934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:28.188847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:28.189272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:28.189682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/d58db031639d4de8bd3158887fae9026/roles/fb967ae279174a67b6758588dc9f7ec2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:28.199979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, user_id=d58db031639d4de8bd3158887fae9026, role_id=fb967ae279174a67b6758588dc9f7ec2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:28.201593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:28.238288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:28.240027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:28.241593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 142/291] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:24:27 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/users/d58db031639d4de8bd3158887fae9026/roles/fb967ae279174a67b6758588dc9f7ec2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:24:28.292776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:28.361933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 150/292] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:24:28.367953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:28.426415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:28.521343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259fa26-b7e8-4c5d-9c38-dba72d278b16 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:28.557618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:28.558262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:28.558535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:28.558802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:28.560043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:28.561547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c27b7-2519-4ee9-9cfe-e98423c0786d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:28.563695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 143/293] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:28 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:28.571214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:28.716364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35ca17-13d2-40b3-ae63-3d3502e43500 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:28.764551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:28.765511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:28.766012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:28.766475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:28.767604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=2c7a4567bc1249bba7a0cb31b71a0c68) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:28.768113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:28.770321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e725b9-bde9-4e8a-91f4-b44458f904b0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:28.780091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 151/294] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:28 2022] GET /identity/v3/role_assignments?user.id=2c7a4567bc1249bba7a0cb31b71a0c68&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=471bd621e24848afa89853237208e118 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:29.224076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a014f-11a5-434a-a4f2-a2b96f932a05 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.224752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a014f-11a5-434a-a4f2-a2b96f932a05 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.225232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a014f-11a5-434a-a4f2-a2b96f932a05 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.227056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 144/295] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:29.232560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d8d1-2159-413b-91ec-d3938d81b55b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.233097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d8d1-2159-413b-91ec-d3938d81b55b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.233563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d8d1-2159-413b-91ec-d3938d81b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.241193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:29.253361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4ea8d8d1-2159-413b-91ec-d3938d81b55b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:29.255071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4ea8d8d1-2159-413b-91ec-d3938d81b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:29.331430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 152/296] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:29.354756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a014f-11a5-434a-a4f2-a2b96f932a05 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.464159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:29.476028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a014f-11a5-434a-a4f2-a2b96f932a05 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:29.511596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:29.512366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.512643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.512913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.527512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:29.534690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:29.535619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:29.536401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:29.538599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 145/297] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:29.542036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f28a-068f-4903-90fc-85035585d501 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.542036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f28a-068f-4903-90fc-85035585d501 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.542036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f28a-068f-4903-90fc-85035585d501 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.542036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 153/298] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:29.542666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.547694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f6db-9cb4-47ff-9f18-ae36b8aa2c1b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.548209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f6db-9cb4-47ff-9f18-ae36b8aa2c1b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.548688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8f6db-9cb4-47ff-9f18-ae36b8aa2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.567960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-01c8f6db-9cb4-47ff-9f18-ae36b8aa2c1b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:29.569122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-01c8f6db-9cb4-47ff-9f18-ae36b8aa2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:29.657042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 154/299] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:29.662754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6327b7-7812-4308-8dec-8586e85adbf9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:29.668452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ef3e-a572-4952-831a-ff497c5f6e78 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.671664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ef3e-a572-4952-831a-ff497c5f6e78 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.671664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9ef3e-a572-4952-831a-ff497c5f6e78 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.671664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 155/300] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:29.675423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.676356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.677232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.697701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:29.699174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:29.702854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:29.703761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.704041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.704308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.704965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:29.705265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:29.706643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:29.714580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 146/301] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:29.715371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.733415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:29.765344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:29.777736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 156/302] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:29.778640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.835526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6e3d-e0f6-4a39-9203-579dd754717f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:29.872398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:29.873025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.873303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.873573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.874672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:29.876120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:29.879290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 147/303] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:29.879290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.897446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4ffeb-9b92-4279-a313-5521274dd723 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:29.938839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:29.939755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:29.940184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:29.940580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] PATH_INFO: `/v3/users/478849ece2af430d8e91db1315918a1b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:29.955947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] RBAC: Authorizing `identity:get_user(user_id=478849ece2af430d8e91db1315918a1b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:29.958025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:29.959730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 157/304] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:29 2022] GET /identity/v3/users/478849ece2af430d8e91db1315918a1b => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:29.960464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:29.976869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:29.998259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31f187-0d52-44c1-9647-bde5b1b1fbd5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.014314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:30.034624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.035289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.035619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.035887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.046072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:30.052234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:30.053231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:30.054077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:30.054654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 148/305] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:30.055079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:30.070452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5100-0549-4e63-b205-54abb3596343 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.105864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.106559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.106841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.107107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] PATH_INFO: `/v3/groups` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.107756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:30.109198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:30.131736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 158/306] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Aug 6 20:24:29 2022] POST /identity/v3/groups => generated 229 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:30.131736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:30.189973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66c76f-3aa9-405f-ad7c-544c5bd1ebab None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.243499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.244174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.244715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.244989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.245735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, user.id=478849ece2af430d8e91db1315918a1b, scope.system=all) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:30.246042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:30.248461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:30.255057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 149/307] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 20:24:30 2022] GET /identity/v3/role_assignments?user.id=478849ece2af430d8e91db1315918a1b&scope.system=all&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:30.278203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d90583-3637-4e6a-be3e-8a3cc8a20674 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.295188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:30.324776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.325408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.325689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.325961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.326647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:30.326948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:30.328722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:30.340596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 159/308] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:30.346365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:30.351085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:30.456960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316dcd9-9fbb-44dd-8df4-7d73342e74dc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.492098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.492761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.492976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.493237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] PATH_INFO: `/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.494361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] RBAC: Authorizing `identity:get_user(user_id=f3d6a2a8f0ff4ddb8fd3fdc786e68895)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:30.495806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e4c74-c362-4eb1-9fca-20d03974438d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:30.497663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 150/309] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:30 2022] GET /identity/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:30.503361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:30.609080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1d64f-251e-46bc-be57-2605a9fa798c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:30.644684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:30.645339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.645616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.645890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] PATH_INFO: `/v3/system/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.647341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f3d6a2a8f0ff4ddb8fd3fdc786e68895, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:30.648732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a852dfe-123a-40d9-807d-dc7b8905dc6e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:30.663394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 160/310] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Aug 6 20:24:30 2022] PUT /identity/v3/system/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:30.767168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b4a9-a6a2-4555-b9d1-0671b1db7dda None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.767503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b4a9-a6a2-4555-b9d1-0671b1db7dda None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.767668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00b4a9-a6a2-4555-b9d1-0671b1db7dda None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.769276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 151/311] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:30.775052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:30.775371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:30.775642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:30.794891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:30.796138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:30.828042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:30.869744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 161/312] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:30.892125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00b4a9-a6a2-4555-b9d1-0671b1db7dda None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:30.970514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:31.008508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00b4a9-a6a2-4555-b9d1-0671b1db7dda None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:31.043540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:31.044078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:31.044412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:31.044680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:31.055982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:31.060685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:31.061526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:31.062310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 152/313] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:31.068306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:31.175882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb83e-656d-45d5-82cf-b7318e3e5e10 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:31.212540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:31.213156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:31.213436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:31.213706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:31.214367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:31.214668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:31.216068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:31.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 162/314] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:31.230262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:31.337457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd23996-bcdc-4dfe-ba8c-cf10a32eba74 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:31.368795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:31.374066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:31.374910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:31.375390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:31.375845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] PATH_INFO: `/v3/users/d58db031639d4de8bd3158887fae9026` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:31.377003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] RBAC: Authorizing `identity:get_user(user_id=d58db031639d4de8bd3158887fae9026)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:31.378503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:31.381774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 153/315] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:31 2022] GET /identity/v3/users/d58db031639d4de8bd3158887fae9026 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:31.387801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:31.418291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:31.498312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a623-906c-4abf-acb6-599841885287 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:31.534763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:31.535478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:31.535762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:31.536064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:31.606692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:31.608235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:31.636473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:31.712857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 163/316] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:24:31.718690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:31.824231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa14bf4-3136-4e37-8042-298d8f06dcfb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:31.860210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:31.861158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:31.861627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:31.862080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:31.863922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:31.865727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccf9cd-18a3-4a68-93a9-e832d29282a1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:31.867965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 154/317] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:31 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:31.879202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:31.983070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a641c-89bf-439b-90dd-680321408fbe None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:32.017648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:32.020778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:32.021410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.021855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.022037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.022659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3, user.id=d58db031639d4de8bd3158887fae9026) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:32.023367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:32.025245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbb50-e17e-48f8-9b85-c0794cf83eb8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:32.031723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 164/318] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:31 2022] GET /identity/v3/role_assignments?user.id=d58db031639d4de8bd3158887fae9026&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:32.269903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16059-f109-4a84-b98b-5a46b415c6bb None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.270247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16059-f109-4a84-b98b-5a46b415c6bb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.270363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16059-f109-4a84-b98b-5a46b415c6bb None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.271874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 155/319] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:32.276838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757b36a-dd45-4663-803c-cc1d24823ed1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.277127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757b36a-dd45-4663-803c-cc1d24823ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.277521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757b36a-dd45-4663-803c-cc1d24823ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.295432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b757b36a-dd45-4663-803c-cc1d24823ed1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:32.296599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b757b36a-dd45-4663-803c-cc1d24823ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:32.364350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 165/320] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:32.386481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16059-f109-4a84-b98b-5a46b415c6bb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.417137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9581a-5804-4797-8cde-a0f269bc0173 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.417424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9581a-5804-4797-8cde-a0f269bc0173 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.417679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9581a-5804-4797-8cde-a0f269bc0173 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.419008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 166/321] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:32.423785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.424064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.424333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.443066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:32.444259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:32.460148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:32.500383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16059-f109-4a84-b98b-5a46b415c6bb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:32.514272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 167/322] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:32.535109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.540090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:32.540747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.541026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.541293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.542435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:32.543939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:32.545628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 156/323] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:32.551842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.591871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:32.646896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091d95f-8917-42ad-89bd-2d0539330d32 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:32.658515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100a183-2d4f-45a7-9231-e7235b8eafc5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:32.679988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:32.680614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.680886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.681152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.690942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:32.695012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:32.695872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:32.696118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:32.696952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:32.697716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 168/324] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:32.698351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.698351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] PATH_INFO: `/v3/groups` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.698963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:32.700324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e47ad-7c35-44c9-baf1-b19ce7561205 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:32.702735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.708446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:32.720122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 157/325] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Aug 6 20:24:32 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:24:32.818540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2bb-c1e7-4a8b-84db-1e8362bd3316 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:32.833373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:32.835944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795586-3807-4d81-ac08-850b953fec40 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.836278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795586-3807-4d81-ac08-850b953fec40 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.836591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795586-3807-4d81-ac08-850b953fec40 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.838128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 158/326] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:32.843966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.844256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.844528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.860318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:32.860994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:32.861270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:32.861535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:32.862204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:32.862501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:32.864150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:32.864501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:32.865384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:32.874096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 169/327] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:32.880163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.937816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 159/328] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:32.961647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:32.991319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35d8a7-9936-426e-8523-a53496ce4c4b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.028147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.029268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.029736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.030188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] PATH_INFO: `/v3/users/478849ece2af430d8e91db1315918a1b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.031586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] RBAC: Authorizing `identity:get_user(user_id=478849ece2af430d8e91db1315918a1b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:33.033480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:33.035518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 170/329] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:32 2022] GET /identity/v3/users/478849ece2af430d8e91db1315918a1b => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:33.042190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:33.074488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b710b-c65f-4e82-b86d-a57e49280f20 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.100113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:33.121627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:33.132239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.132879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.133155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.133420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.148398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:33.157248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:33.158156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:33.158945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 160/330] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:33.168058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:33.176549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38429b-cc9c-4ea1-b5ed-86d3c8850d9c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.222056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.223353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.223627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.223892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] PATH_INFO: `/v3/system/users/478849ece2af430d8e91db1315918a1b/roles/fb967ae279174a67b6758588dc9f7ec2` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.226379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=478849ece2af430d8e91db1315918a1b, role_id=fb967ae279174a67b6758588dc9f7ec2)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:33.227836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:33.243409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 171/331] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Aug 6 20:24:33 2022] PUT /identity/v3/system/users/478849ece2af430d8e91db1315918a1b/roles/fb967ae279174a67b6758588dc9f7ec2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:24:33.310341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491f7e-639b-4e4c-831d-9976ed42414e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.355949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.356935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.357413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.357881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.358759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:33.359327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:33.360958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:33.372763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 161/332] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:33.378065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:33.497847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc320a-4bb6-4869-8056-671f9b701093 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.506278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:33.535899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.536532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.536809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.537072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] PATH_INFO: `/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.538219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=f3d6a2a8f0ff4ddb8fd3fdc786e68895)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:33.539776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe307243-9783-46ed-9581-d21ef0bb3aa9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:33.541704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 172/333] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:33 2022] GET /identity/v3/users/f3d6a2a8f0ff4ddb8fd3fdc786e68895 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:33.547165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:33.607694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:33.655434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e0fea-2e2d-4b7c-86da-7f50ec99c312 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:33.690301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:33.690966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:33.691802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:33.692071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:33.692999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] RBAC: Adding query filter params (role.id=471bd621e24848afa89853237208e118, user.id=f3d6a2a8f0ff4ddb8fd3fdc786e68895, scope.system=all) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:33.693352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:33.694809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f2d92-9fc2-48e0-a5fe-a870111b53fe None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:33.707865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 162/334] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 20:24:33 2022] GET /identity/v3/role_assignments?user.id=f3d6a2a8f0ff4ddb8fd3fdc786e68895&scope.system=all&role.id=471bd621e24848afa89853237208e118 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:35.580728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5919-cf97-4f5e-a2ab-abbaed38c18c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:35.581235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5919-cf97-4f5e-a2ab-abbaed38c18c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:35.581580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5919-cf97-4f5e-a2ab-abbaed38c18c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:35.583346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 173/335] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:35.601402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183581e4-3cf4-4104-82d6-69f13f6a4fce None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:35.601816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183581e4-3cf4-4104-82d6-69f13f6a4fce None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:35.602128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183581e4-3cf4-4104-82d6-69f13f6a4fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:35.624573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-183581e4-3cf4-4104-82d6-69f13f6a4fce None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:35.625902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-183581e4-3cf4-4104-82d6-69f13f6a4fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:35.711379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 163/336] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:35.752698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5919-cf97-4f5e-a2ab-abbaed38c18c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:35.865302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc203d-8e7e-4e7e-997b-95d0b9d11667 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:35.865534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc203d-8e7e-4e7e-997b-95d0b9d11667 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:35.865869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc203d-8e7e-4e7e-997b-95d0b9d11667 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:35.867429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 164/337] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:35.873135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a18b2-321b-40ca-81db-21d428ac9266 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:35.873418 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a18b2-321b-40ca-81db-21d428ac9266 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:35.873695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a18b2-321b-40ca-81db-21d428ac9266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:35.909425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-160a18b2-321b-40ca-81db-21d428ac9266 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:35.911999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5919-cf97-4f5e-a2ab-abbaed38c18c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:35.915037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-160a18b2-321b-40ca-81db-21d428ac9266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:35.965474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:35.987954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:35.989134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:35.989409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:35.989674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.023297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-eb8a7117-6af7-4ea7-a634-456da0ce77e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:36.028136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:36.028999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:36.029760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 174/338] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:36.030859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d46b-aece-4812-969a-e83281d5af1d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.031272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d46b-aece-4812-969a-e83281d5af1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.035585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4d46b-aece-4812-969a-e83281d5af1d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.037286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 175/339] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:36.038023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d46b-aece-4812-969a-e83281d5af1d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.038681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 165/340] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:36.043068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.043397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.043672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.080321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:36.081581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:36.110100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.173739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 166/341] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:36.174934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.209216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4d46b-aece-4812-969a-e83281d5af1d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.259719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.260331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.260603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.260867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.261538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:36.261835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:36.263228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:36.279098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 176/342] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:36.280434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.289516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.298057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca979c-3c36-4c43-8315-5cdcb1c15705 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.340294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.340944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.341230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.341660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.354828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:36.360794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:36.361647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:36.362415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 167/343] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:36.363765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.461954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.474615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5f8d-2d1d-4cd1-b422-a503288d2806 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.482056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db66e-806d-4c0f-9758-034f476c53f6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.520858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.521510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.521869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.522145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.524368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.525041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.525324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.525601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.534902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:36.539838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:36.540768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:36.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 177/344] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:36.542296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.562347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.627487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:36.629488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:36.672843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be405488-9284-446c-9767-d8d5eeb92ecb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.713836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.714473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.714817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.715160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.715933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:36.716246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:36.717641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeff219-a801-4d8c-be6f-27a7e2247c81 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:36.727402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 178/345] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:36.728711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea4cb-1535-44b2-8389-f4c68fb0cb19 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.728992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea4cb-1535-44b2-8389-f4c68fb0cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.729263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea4cb-1535-44b2-8389-f4c68fb0cb19 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.731916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 179/346] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:36.733293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828bb6-e49d-47d9-bfbf-fc128c7b60f6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.733717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828bb6-e49d-47d9-bfbf-fc128c7b60f6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.734138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52828bb6-e49d-47d9-bfbf-fc128c7b60f6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.735667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 180/347] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:36.738859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828bb6-e49d-47d9-bfbf-fc128c7b60f6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.762744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 168/348] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:36.763787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:36.765410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.840252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:36.870116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52828bb6-e49d-47d9-bfbf-fc128c7b60f6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.899638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d39020-4bb0-4bd0-869d-0637f6c47c1d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:36.915058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.915795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.916221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.916495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.917543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:36.918090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:36.920491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9109961-f939-4011-9718-e5029d817a5c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:36.933499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 181/349] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:36.934888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49eff-fa83-4703-ac65-ace70e9e4be6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.935173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49eff-fa83-4703-ac65-ace70e9e4be6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.935507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a49eff-fa83-4703-ac65-ace70e9e4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.945652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:36.946567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:36.947061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:36.947550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:36.957051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b6a49eff-fa83-4703-ac65-ace70e9e4be6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:36.958249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b6a49eff-fa83-4703-ac65-ace70e9e4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:37.047194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.048287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 182/350] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:37.048649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.050005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.051131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.051650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.071831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:37.073375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:37.078053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.123503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.163815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 183/351] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:37.164994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.178963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 169/352] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:37.180979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.312025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ba479-2c12-4a78-b975-625cf66b167f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.316017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac626c-2465-44a2-9218-8ea7e28d4931 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.357863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.357863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.357863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.358199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.361795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.363350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.363633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.363903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.367328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.368720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.370743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 184/353] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:37.371549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.386701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.392925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.446961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.448441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.511544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e5c48-ef7e-48b6-94c3-2db291c6773f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.556167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.556862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.557143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.557408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.562871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 170/354] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:37.563745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.569185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:37.573917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:37.574772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:37.575572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 185/355] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:37.576218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.636452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.661756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.687554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f930c1-63ac-4a3c-9cb6-2add211b769b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.698422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9806700-0655-4a5d-bb7b-5d08e45e32bf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.730138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.730761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.731033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.731400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.732509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.733923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.739348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 171/356] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:37.740407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.743731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.744368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.744639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.744904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.756522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-92a98948-925c-4468-8791-207adbe6ba96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:37.761415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:37.762318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:37.763101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 186/357] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:37.763781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a418-aa00-44cc-8d51-7f83a03edc82 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.764320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a418-aa00-44cc-8d51-7f83a03edc82 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.764320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77a418-aa00-44cc-8d51-7f83a03edc82 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.767585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 187/358] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:37.767585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77a418-aa00-44cc-8d51-7f83a03edc82 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.862315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf61c2-1569-4f26-b26b-f0019618a791 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.887495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.900063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77a418-aa00-44cc-8d51-7f83a03edc82 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:37.901261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.902109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.902591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.902923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.909620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.911645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.913272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 172/359] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:37.914032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:37.930558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:37.938992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:37.939666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:37.939947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:37.940217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:37.942326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:37.944067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:37.946497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 188/360] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:37.947290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.028589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c7f3-35f0-4e98-93b7-5720e125e79b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.062502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be149ca9-34ed-4f5d-898b-fc0cef177690 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.067380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.067991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.068264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.068531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.069194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:38.069492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.070847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.080490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 173/361] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.081372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.108532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.109434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.109712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.109980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.111099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.112630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072c287-c311-41f7-86e4-9da86dfd6379 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.114704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 189/362] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:37 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.115841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.116121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.116389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.136842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:38.138010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:38.143270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.203233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee043ec0-6e2e-4b0e-b304-622e1ff1a65a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.212875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.225407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 190/363] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:38.226421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.246185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.246880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.247151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.247487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.248537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:38.248537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.249790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.261041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 174/364] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.261041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.344865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f82d7-9e5a-47c9-ab20-c5250d2251c3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.373668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aa519-992e-401d-aba2-dde3e9ffec66 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.378423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.379043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.379349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.379619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.380331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=471bd621e24848afa89853237208e118, scope.project.id=542dcebbf30642e39296c8926a46b61a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:38.380632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.382068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.386698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.387187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 191/365] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=471bd621e24848afa89853237208e118 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.387978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.411376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.412367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.412647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.412915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.414142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.415869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.417625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 175/366] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.418423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.470624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.522107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9031c-366d-4fcb-830e-c92c1493e898 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.529395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49efad-b480-4a05-9903-efe75645bc80 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.565073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.565687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.565974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.566273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.566815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.567406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.567689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.567960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.568685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=542dcebbf30642e39296c8926a46b61a) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:38.568993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.570435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.576098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 176/367] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.576888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.657187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.660987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.663343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.740028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b20e-2212-465c-afac-f20901ffdb39 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.745065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.782657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.783433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.783723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.783991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.798682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:38.804254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 192/368] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:38.805300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:38.806009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:38.806846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:38.807653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:38.810907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 177/369] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:38.811872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.927643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ab8ca-3c27-4070-b0dc-321527c71b26 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.929942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:38.934901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa114-47c2-4b5e-be2b-87b64f396121 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:38.964169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.964765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.965039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.965304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.966119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=471bd621e24848afa89853237208e118, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:38.966425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.968158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.972806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:38.973679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:38.974150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:38.974395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 178/370] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=471bd621e24848afa89853237208e118 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.974810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] PATH_INFO: `/v3/users/478849ece2af430d8e91db1315918a1b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:38.975165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:38.976524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] RBAC: Authorizing `identity:get_user(user_id=478849ece2af430d8e91db1315918a1b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:38.978229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:38.980190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 193/371] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/users/478849ece2af430d8e91db1315918a1b => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:38.981233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.010956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.091915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc09a34-1481-46d2-8e47-79fa71302886 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.092113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b5e-c441-49d5-85e1-18286dceeefc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.130088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.130507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.131148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.131451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.131718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.131969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.132543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.132881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.133298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.134175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:39.134348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.134853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.136027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 179/372] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:39.136759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.136867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.148363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 194/373] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:39.149933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.188289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.278434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.289166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a0ec-e5e7-4f33-b817-ae3bcdfbda8d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.294156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0f841-7aa0-4849-96a7-45fa74875af1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.327781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.328123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.328388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.328658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.330667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] RBAC: Adding query filter params (role.id=fb967ae279174a67b6758588dc9f7ec2, user.id=478849ece2af430d8e91db1315918a1b, scope.system=all) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:39.330667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.331574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.335456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.336327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.336792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.337261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.338657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.340401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.342252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 195/374] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:39.343182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.350684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 180/375] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/role_assignments?user.id=478849ece2af430d8e91db1315918a1b&scope.system=all&role.id=fb967ae279174a67b6758588dc9f7ec2 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:39.357234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.456553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f719b-2393-402c-ad07-57e3d6c044dc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.479317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.497427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06292e-8a4a-45e8-9c97-b098f9f00c38 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.499371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.500290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.500784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.501238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.529894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.560074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.560774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.561058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.561332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.562169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:39.562502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.564126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.570996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 181/376] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:39.582904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.584787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.698196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 196/377] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:39.704216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.825540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf467d-41b6-45ba-9bac-f149aa08fa68 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:39.869463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:39.870096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:39.870369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:39.870633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] PATH_INFO: `/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:39.871796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] RBAC: Authorizing `identity:get_project(project_id=2ec2c82e54624d69af0962b9e3a7a4d9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:39.873319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:39.875234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 182/378] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:39.881395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:39.951935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:39.999892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d065b-5fe2-4c97-b5cd-5f44fd27ceb8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:40.035980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:40.036607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.036880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.037143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] PATH_INFO: `/v3/groups/d51f41433d804138a438b9434d0a39a7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.043187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] RBAC: Authorizing `identity:get_group(group_id=d51f41433d804138a438b9434d0a39a7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:40.044648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e773a50-632c-4fd6-8134-128ce578a7cc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:40.046234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 197/379] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:39 2022] GET /identity/v3/groups/d51f41433d804138a438b9434d0a39a7 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:40.052617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:40.085594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:40.174949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81f836-52f1-4f08-9ca9-c2f190abcb1c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:40.218080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:40.218689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.218975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.219259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.220007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] RBAC: Adding query filter params (group.id=d51f41433d804138a438b9434d0a39a7, role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=2ec2c82e54624d69af0962b9e3a7a4d9) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:40.220314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:40.221730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfde85d-d610-4e6d-9031-12ffa2d55292 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:40.228045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 183/380] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:40 2022] GET /identity/v3/role_assignments?group.id=d51f41433d804138a438b9434d0a39a7&scope.project.id=2ec2c82e54624d69af0962b9e3a7a4d9&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:40.855217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b06f-2f24-480e-8e61-b554f0757174 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.855437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b06f-2f24-480e-8e61-b554f0757174 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.855699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b06f-2f24-480e-8e61-b554f0757174 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.857297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 198/381] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:40.863478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.863963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.864038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.884137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:40.885298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:40.897652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd6efe-bcc9-493f-bb53-31d488fa5da6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.898172 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd6efe-bcc9-493f-bb53-31d488fa5da6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.898172 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd6efe-bcc9-493f-bb53-31d488fa5da6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.899653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 199/382] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:40.904785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:40.905068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:40.905341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:40.935271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:40.936455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:41.015311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 184/383] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:41.048848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 200/384] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:41.068713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.071522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.102310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.150704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.246660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39718dc7-8a8f-42e9-bc8e-764bd9ca09e7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.251848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aca6ef-ddda-4ea1-ba93-7e344659ec6e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.306130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.307040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.307365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.307663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.320248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:41.326062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:41.326999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:41.328272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 185/385] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:41.334689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.353217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.353867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.354176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.354469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.372850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:41.378097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:41.379571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:41.380336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:41.387730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 201/386] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:41.388576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.439542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.464504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce718-a403-4099-93e7-9cffb4a6a541 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.517652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.518263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.518538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.518807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.519523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:41.519824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:41.521293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:41.533033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d72d8f-32fa-4438-a8a6-ce94f34a6819 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.537782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 186/387] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:41.548441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.550157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.576139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.576754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.577032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.577303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.577973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:41.578274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:41.579986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:41.588863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 202/388] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:41.594287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.716081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f8911-46ef-463b-83d0-fa44c4fe6d38 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.754716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.756129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.756634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.757099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.759012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:41.761009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:41.763330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 203/389] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:41.769751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.789503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a6984-cba7-4ac1-9d70-0f5fcb216181 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.823593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.842104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.842741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.843018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.843313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.844423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:41.845920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:41.848248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 187/390] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:41.856249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:41.881572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:41.906003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53148ff3-8470-4f1e-981e-9d953502455f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:41.983946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:41.984509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.985089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.985361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.986862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:41.989198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b73c11-6418-4afa-84c1-66908ee75d21 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:41.991764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 204/391] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:41.992976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004386b-e6a7-4b12-b4c4-a0dcb5275b40 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:41.993255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004386b-e6a7-4b12-b4c4-a0dcb5275b40 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:41.993522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004386b-e6a7-4b12-b4c4-a0dcb5275b40 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:41.994833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 205/392] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:41.999460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004386b-e6a7-4b12-b4c4-a0dcb5275b40 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.031975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ff5ac-6580-4483-8b0c-cd90a112138b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.068100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.069151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.069432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.069750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.070929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.073257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ee40d-2eda-49e9-abcd-45919465733b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.076285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 188/393] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:41 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:42.078201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.078487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.079304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.107005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:42.108480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:42.127382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004386b-e6a7-4b12-b4c4-a0dcb5275b40 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.138549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.171209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.171957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.172478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.172752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/groups/39a1073a836448dfb7d83491d1c4850a/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.176443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, group_id=39a1073a836448dfb7d83491d1c4850a, role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.179728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.182933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 189/394] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:42.183998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.204079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.207846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 206/395] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 20:24:41 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/groups/39a1073a836448dfb7d83491d1c4850a/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:42.213927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.358286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce082a-9f89-4e46-86db-a58f6c8077e9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.383712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31c5f6-f976-4e1f-b516-93885ef5265f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.406025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.407086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.407617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.408082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.423693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:42.426952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.427658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.427938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.428208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a/groups/39a1073a836448dfb7d83491d1c4850a/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.430219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] RBAC: Authorizing `identity:create_grant(project_id=542dcebbf30642e39296c8926a46b61a, group_id=39a1073a836448dfb7d83491d1c4850a, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-47e2d6da-1042-4f39-a59e-d60369e4d7b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:42.431084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:42.432145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:42.433099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:42.433817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13b86d-1531-4640-b9e4-84ab4fcbf550 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.435928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 207/396] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:42.437920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562786-2d0a-42f0-86f7-acb3b54faa3b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.438483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562786-2d0a-42f0-86f7-acb3b54faa3b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.439310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79562786-2d0a-42f0-86f7-acb3b54faa3b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.442009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 208/397] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:42.443222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562786-2d0a-42f0-86f7-acb3b54faa3b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.448968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 190/398] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 20:24:42 2022] PUT /identity/v3/projects/542dcebbf30642e39296c8926a46b61a/groups/39a1073a836448dfb7d83491d1c4850a/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:42.450438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.450796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.451137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.479172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:42.480990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:42.490121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.552300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.560071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 191/399] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:42.591761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.592061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79562786-2d0a-42f0-86f7-acb3b54faa3b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.634289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.634971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.635385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.635660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.636392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:42.636702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.638188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.649132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 209/400] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:42.659093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.711688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e1a5-b189-4b1a-aa0d-95649444d221 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.755175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.755890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.756164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.756481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.773779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:42.779824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:42.780739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:42.781508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:42.783864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.785472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 192/401] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:42.790288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.791509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6f353-351a-4a3e-8b50-68d1129a9d21 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.855032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:42.868110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.868774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.869055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.869332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.870519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.871978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.874060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 210/402] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:42.884248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:42.901318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcdad5-f5bd-4d14-9030-0c2732f99900 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:42.947284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:42.947910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.948178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.948436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.949105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:42.949403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:42.950796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088415cf-8c37-4079-961d-cf918b575824 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:42.959659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 193/403] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:42.960875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba52d5-6058-4a29-97ab-52097a6e0977 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:42.961156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba52d5-6058-4a29-97ab-52097a6e0977 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:42.961427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba52d5-6058-4a29-97ab-52097a6e0977 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:42.962903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 194/404] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:42.967499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba52d5-6058-4a29-97ab-52097a6e0977 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.029884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee989ee9-648e-4f2f-82d8-3f4a675afe30 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.074843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba52d5-6058-4a29-97ab-52097a6e0977 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.075166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.075887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.076233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.076569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.078611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.080352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f556-6506-48a5-8a9e-0599be37aa7f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.082808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 211/405] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:43.084535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.084813 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.085079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.102408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.107322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:43.109248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:43.121047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.121933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.122380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.122740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.124142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.125656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.127872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 195/406] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:42 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:43.128801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.135149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.207407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 212/407] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:43.207407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.265123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b1a9e-1cba-4405-baa7-140dd42c25b8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.302326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.303082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.303519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.303855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/groups/39a1073a836448dfb7d83491d1c4850a/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.305808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, group_id=39a1073a836448dfb7d83491d1c4850a, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.307399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.324162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 196/408] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 20:24:43 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/groups/39a1073a836448dfb7d83491d1c4850a/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:43.325281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.327766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf347-0f22-4a37-956f-b72d7b4fee82 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.368239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.369021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.369302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.369573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.370703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.372180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.374287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 213/409] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:43 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:43.384465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.385824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.436197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.455967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9aaef-367f-496d-981a-784bf6def8ec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.494621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.495710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.496185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.496645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.508237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:43.513444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:43.514283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:43.515060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 197/410] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:43.521454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.577741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f00e-c5af-40e7-b3fe-46057e6de761 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.653390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.654422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.654896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.655386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/groups/39a1073a836448dfb7d83491d1c4850a/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.663983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] RBAC: Authorizing `identity:create_grant(project_id=78793b2fc14a45bd88b69e033cb8a9b3, group_id=39a1073a836448dfb7d83491d1c4850a, role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.665746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.666837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fc566-cf11-4e81-920d-727e280e6536 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.678757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.687844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 214/411] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 20:24:43 2022] PUT /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3/groups/39a1073a836448dfb7d83491d1c4850a/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:43.715098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.719432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.719884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.720298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.721127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:43.721582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.723802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.735013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 198/412] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:43.740979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:43.872011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:43.896909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acab856-c22b-45ac-b839-ef30ed56452c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:43.944240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:43.944884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:43.945161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:43.945431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] PATH_INFO: `/v3/groups/d51f41433d804138a438b9434d0a39a7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:43.947378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] RBAC: Authorizing `identity:get_group(group_id=d51f41433d804138a438b9434d0a39a7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:43.948835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:43.950706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 215/413] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:43 2022] GET /identity/v3/groups/d51f41433d804138a438b9434d0a39a7 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:43.956302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:44.084467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a9bee-34fd-4f88-ade7-9650fcc7cf22 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:44.127286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:44.127842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.128170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.128446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] PATH_INFO: `/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.129597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] RBAC: Authorizing `identity:get_project(project_id=2ec2c82e54624d69af0962b9e3a7a4d9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:44.131032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429edb6-3c3c-4d82-9dfc-a8678b75e07e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:44.132992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 199/414] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:43 2022] GET /identity/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:44.138556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:44.272578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353428-510f-4900-a40a-a96456c68eb9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:44.318811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:44.319506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.319783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.320053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] PATH_INFO: `/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9/groups/d51f41433d804138a438b9434d0a39a7/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.324479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ec2c82e54624d69af0962b9e3a7a4d9, group_id=d51f41433d804138a438b9434d0a39a7, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:44.325920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239ff8-5ac9-4b37-8df7-6d1bce9aaed2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:44.341747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 216/415] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 20:24:44 2022] PUT /identity/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9/groups/d51f41433d804138a438b9434d0a39a7/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:24:44.867491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cb6d-ddc2-4863-b5fa-fbf3286aa048 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.868178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cb6d-ddc2-4863-b5fa-fbf3286aa048 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.868681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034cb6d-ddc2-4863-b5fa-fbf3286aa048 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.870453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 200/416] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:44.876114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.876401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.876677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.904411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:44.905768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:44.914623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:44.943040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc4d1-940f-4dee-80bf-e751c8fe0a5a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.943954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc4d1-940f-4dee-80bf-e751c8fe0a5a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.944693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc4d1-940f-4dee-80bf-e751c8fe0a5a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.947077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 201/417] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:44.951869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:44.952356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:44.952848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:44.985428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:44.986622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:45.007598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 217/418] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:45.038877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.064190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.106183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 202/419] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:45.142938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.195382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515385c-b9a0-42a2-af68-f284c72c3221 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.242358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.242992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.243481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.243854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.256351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:45.261653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:45.262968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:45.264162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:45.266143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 218/420] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:45.272562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.278289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.364412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b6889-1228-40b9-ab9b-d28b865d3063 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.435629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.436251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.436533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.436804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.446659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1842c98-586c-4808-9422-c2d61b5dbd0a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.464162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:45.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:45.469947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:45.470713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:45.479720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 203/421] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:45.486272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.497317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.497946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.498225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.498492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.499339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:45.499667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:45.504278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:45.520974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 219/422] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:45.526233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.527528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.613674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcd837-66e5-4be7-b381-5bf6a1a6fb01 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.656611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.656845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.658671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.659149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.659725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.661600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:45.662836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:45.664894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e416c7-7a96-42b1-a299-c72209b1e7a9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:45.676892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 204/423] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:45.681753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017564-53db-46a9-b7ee-21ba8d518153 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.681753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017564-53db-46a9-b7ee-21ba8d518153 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.681753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017564-53db-46a9-b7ee-21ba8d518153 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.682903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 205/424] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:45.685044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017564-53db-46a9-b7ee-21ba8d518153 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:45.716258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44141c8-16b9-4644-b8a7-62e2a57070fd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.765830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.766853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.767374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.767870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.786626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.798081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017564-53db-46a9-b7ee-21ba8d518153 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:45.843417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:45.843775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.844022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.844293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:45.865493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:45.867333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fceb45-8283-450e-b398-d5b566e0c6dd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:45.936866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:45.937617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:45.939258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:45.981764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 220/425] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:45.982976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:45.983271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:45.983601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.004957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:46.007303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:46.055899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.078668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 206/426] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:46.078668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.087593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 221/427] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:46.095266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.183810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.189985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a23561-b59c-4d8a-a92e-506f4c710f1f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.225525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1fe4b-ca67-4c13-96bb-109931dbe9f1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.225862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.226592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.226964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.227369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.228594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.230479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.236458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 222/428] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.236458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.280571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.281400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.281843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.282275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] PATH_INFO: `/v3/projects/542dcebbf30642e39296c8926a46b61a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.283987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] RBAC: Authorizing `identity:get_project(project_id=542dcebbf30642e39296c8926a46b61a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.285941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.291300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 207/429] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/projects/542dcebbf30642e39296c8926a46b61a => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.291300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.342024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41610e-592e-4000-b90e-9f1c60221e0c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.361269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.377085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277f2a-9495-4609-9455-173474721527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.377711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f2a-9495-4609-9455-173474721527 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.377982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f2a-9495-4609-9455-173474721527 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.378248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f2a-9495-4609-9455-173474721527 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.389349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34277f2a-9495-4609-9455-173474721527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-34277f2a-9495-4609-9455-173474721527 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:46.394091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:46.395041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:46.395843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 223/430] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:46.396503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d0b5-2212-47f8-ba4c-ce079e39e421 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.397072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d0b5-2212-47f8-ba4c-ce079e39e421 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.397072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4d0b5-2212-47f8-ba4c-ce079e39e421 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.402222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 224/431] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:46.402222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4d0b5-2212-47f8-ba4c-ce079e39e421 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.422068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd370dd-a8db-4a1f-aab6-d188504e7fa7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.427668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.466306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.467127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.467604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.468037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.469713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.471673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.474487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 208/432] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.480419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.510649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4d0b5-2212-47f8-ba4c-ce079e39e421 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.545616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.546237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.546507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.546774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.547877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.549355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628245c4-afc0-4ff1-b7a3-6efd242b3da4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.556430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 225/433] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.556430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.556430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.556430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.571902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:46.573066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:46.614627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8dc206-c420-4c1c-bde6-4bcd0715a46f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.645987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 226/434] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:46.646501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.646820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.671958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.672749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.673169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.673688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.674017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.675368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:46.676739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.678551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.689519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 209/435] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.690334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.764089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a806c-a680-472e-9de7-85a7b8e7d62c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.792111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c7c6f-3f37-4b18-b131-08f2f22655dc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:46.802693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.803391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.803688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.803965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.804766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=542dcebbf30642e39296c8926a46b61a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:46.805097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.806674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.819659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 227/436] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.820665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.834148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:46.834784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:46.835093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:46.835402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:46.836156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=471bd621e24848afa89853237208e118, scope.project.id=542dcebbf30642e39296c8926a46b61a) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:46.836464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:46.838595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:46.846370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 210/437] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=542dcebbf30642e39296c8926a46b61a&role.id=471bd621e24848afa89853237208e118 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:46.847909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:46.937256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.954854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:46.958421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b8d7-7605-4209-855a-545b885d27f6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.011778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.012463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.012747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.013065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.030552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3b8a1d45-c9e9-411f-a5a9-5d127e8cbd16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:47.036154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:47.037017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:47.037836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 228/438] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:47.038503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33157-ee4e-483a-9b7f-879928f111c6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.038568 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33157-ee4e-483a-9b7f-879928f111c6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.038922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be33157-ee4e-483a-9b7f-879928f111c6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.043375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 229/439] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:47.043730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f404-2cfd-4d9a-b0cd-01e810fc0f98 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.044508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33157-ee4e-483a-9b7f-879928f111c6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.089528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.090167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.090465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.090739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.158932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be33157-ee4e-483a-9b7f-879928f111c6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.179344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.180805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.205121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.205739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.206015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.206280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.206980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:47.207322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.208686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccea7b5-c5ab-43ab-86e5-956f4ee29d7a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.218575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 230/440] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.219843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.220837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.220837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.233798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.240556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.244182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:47.245377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:47.304481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 211/441] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:47.305562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.339387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 231/442] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:47.340659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.423041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643106cd-f498-4625-b5ed-2787aa8e207f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.449972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c3201-9a82-4a64-b9a4-f2e5ab77535b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.456264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.457412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.457684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.457957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.478617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.484599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.485223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.485500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.485772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.486881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.488389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.489992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 232/443] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.490744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.495666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.528412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.529870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.594844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0148e-db81-4d77-b29e-b654c577525d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.626624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 212/444] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:47.628800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.629438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.629714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.629979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.632219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.641369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:47.646578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:47.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:47.648613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 233/445] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:47.649477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.686783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.710189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.735201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fca734-9386-4ad1-b7c2-f1cb2f66f7ef None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.747426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb64d5-93cd-40a5-ad25-f29c53b7aa3b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.768545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.769244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.769526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.769797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.770891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.772343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.773901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 213/446] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.774654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.781143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.781773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.782052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.782327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] PATH_INFO: `/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.783478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] RBAC: Authorizing `identity:get_project(project_id=78793b2fc14a45bd88b69e033cb8a9b3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.785454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.787174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 234/447] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/projects/78793b2fc14a45bd88b69e033cb8a9b3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.787822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.872586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8388ff-facb-43dc-bb04-4ed2c87037e0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.884829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4abfc3-2f3e-4bcd-a87c-bd84feae67ff None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:47.891755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.905693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.906299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.906574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.906848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.907561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:47.907861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.909203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.917257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:47.917549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 214/448] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.918315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:47.922654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:47.923569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:47.923875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:47.924158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:47.925204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=471bd621e24848afa89853237208e118, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:47.926392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:47.928192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:47.934132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 235/449] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=471bd621e24848afa89853237208e118 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:47.934899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:48.035597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2d7b8-2618-43e6-948e-df7ac5d61bdf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.047367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e750ec4-2eff-4aac-a3c0-4c7f01337077 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.075094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.075758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.076036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.076308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] PATH_INFO: `/v3/groups/39a1073a836448dfb7d83491d1c4850a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.077441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] RBAC: Authorizing `identity:get_group(group_id=39a1073a836448dfb7d83491d1c4850a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.078879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.081444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 215/450] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/groups/39a1073a836448dfb7d83491d1c4850a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:48.087566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:48.087937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.088557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.088836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.089110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.145265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:48.156184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:48.166272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.167928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.207910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c17dc2-9f5b-46ff-aa74-b728b055da5a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.255799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.256410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.256687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.256960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.257687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] RBAC: Adding query filter params (group.id=39a1073a836448dfb7d83491d1c4850a, role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:48.257994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.259570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.266198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 216/451] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:48 2022] GET /identity/v3/role_assignments?group.id=39a1073a836448dfb7d83491d1c4850a&scope.project.id=78793b2fc14a45bd88b69e033cb8a9b3&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:48.286041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 236/452] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:48.292042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:48.402602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dba77-2674-4746-98fe-97887faebeaa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.417476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:48.440334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.440692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.440971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.441763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] PATH_INFO: `/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.442881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] RBAC: Authorizing `identity:get_project(project_id=2ec2c82e54624d69af0962b9e3a7a4d9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.444353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.445966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 217/453] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:24:48 2022] GET /identity/v3/projects/2ec2c82e54624d69af0962b9e3a7a4d9 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:48.451530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:48.544677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:48.550891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11513ce-1613-46d8-83aa-f2fbb0b381e6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.589175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.589809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.590089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.590358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] PATH_INFO: `/v3/groups/d51f41433d804138a438b9434d0a39a7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.591528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] RBAC: Authorizing `identity:get_group(group_id=d51f41433d804138a438b9434d0a39a7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.592976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce537179-a925-4c95-910d-9007c30f5e29 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.594531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 237/454] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 20:24:48 2022] GET /identity/v3/groups/d51f41433d804138a438b9434d0a39a7 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:48.600570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:48.699169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b981a-120f-4434-a374-36fa12a20914 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:48.731479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:48.732066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:48.732345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:48.732613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:48.733319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] RBAC: Adding query filter params (group.id=d51f41433d804138a438b9434d0a39a7, role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=2ec2c82e54624d69af0962b9e3a7a4d9) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:48.733624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:48.735040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352dd3-9c62-4438-90f4-fce2206e00d6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:48.740591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 218/455] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 20:24:48 2022] GET /identity/v3/role_assignments?group.id=d51f41433d804138a438b9434d0a39a7&scope.project.id=2ec2c82e54624d69af0962b9e3a7a4d9&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:51.077035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a3b9-9a7e-4f4d-99d2-8c8328e26336 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.077542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a3b9-9a7e-4f4d-99d2-8c8328e26336 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.077643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52a3b9-9a7e-4f4d-99d2-8c8328e26336 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.079696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 238/456] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:51.085305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc243-5058-4a45-8b72-65b6946bca88 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.086192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc243-5058-4a45-8b72-65b6946bca88 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.086657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cc243-5058-4a45-8b72-65b6946bca88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.116423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c45cc243-5058-4a45-8b72-65b6946bca88 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:51.117989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c45cc243-5058-4a45-8b72-65b6946bca88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:51.176652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:51.213616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 219/457] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:51.227698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907d89-1b73-4871-b0dd-a88c1ae17ab7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.228167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907d89-1b73-4871-b0dd-a88c1ae17ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.228694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48907d89-1b73-4871-b0dd-a88c1ae17ab7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.230388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 239/458] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:51.235794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774d9a-7a1e-48c4-8bc5-a7ea64e6d616 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.236073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774d9a-7a1e-48c4-8bc5-a7ea64e6d616 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.236341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22774d9a-7a1e-48c4-8bc5-a7ea64e6d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.243766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48907d89-1b73-4871-b0dd-a88c1ae17ab7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.260643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-22774d9a-7a1e-48c4-8bc5-a7ea64e6d616 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:51.263898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-22774d9a-7a1e-48c4-8bc5-a7ea64e6d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:51.379345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 220/459] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:51.379345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051d9a-c81f-49d2-8c24-57488862dc2d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.379345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051d9a-c81f-49d2-8c24-57488862dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.379345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1051d9a-c81f-49d2-8c24-57488862dc2d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.379345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 221/460] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:51.385213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.385488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.385763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.417217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:51.419520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:51.422238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48907d89-1b73-4871-b0dd-a88c1ae17ab7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:51.472744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:51.473870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.474359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.474821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.485952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:51.487782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:51.499936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 222/461] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:51.500845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:51.504578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:51.505458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:51.506284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:51.506284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.506284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:51.508242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 240/462] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:51.514072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.534853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:51.541659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:51.635746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cca9a-4dcb-423e-a5bb-9e54278efe9a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:51.639089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60712e-c607-4dda-a3a3-af31741e67b1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:51.671502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:51.672400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.672851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.673291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.674129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:51.674598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:51.676187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:51.679854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:51.680517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.680740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.680999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.693080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:51.695120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:51.698112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 241/463] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:51.699416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:51.716365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:51.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:51.718164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:51.718164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.718164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:51.718164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 223/464] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:51.718383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.805874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:51.829360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:51.836684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55618b9-4844-4ec0-8a1b-c5d458d4b29f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:51.844328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bfb08-3f2d-4d8b-9909-1587a1d57adb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:51.880775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:51.881891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.882379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.882886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.883437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:51.883851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:51.884244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:51.884614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:51.884976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:51.886117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:51.897370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:51.899566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:51.908950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 224/465] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:51 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:51.910642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:51.919151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:51.920178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:51.920994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:51.920994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:51.920994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:51.923206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 242/466] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:51.929614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.045383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72471cd-39ca-4f7c-8a54-8bac9a1c13e7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.055109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5babf6-0eb2-4383-b851-1d77b7aa7c79 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.075657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:52.086596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.087976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.088429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.088937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.089794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:52.090293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.091929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.098900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.099540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.099811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.100078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.100732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:52.101028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.103033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.108966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 243/467] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:52.114656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.119322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 225/468] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:52.123065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.132097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:52.250455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fafa88-8367-42eb-8cc7-15ad004c60a8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.262223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593dd92-1000-4060-ab8c-7c4d7f0f99eb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.289937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.290652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.291002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.291371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.292192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.293815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22774e-3185-44ac-ad55-49f5d9c03d6c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.300569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.301409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.301870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.302302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.303101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.304731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.322672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 244/469] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:52.323945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5563-0745-41ea-a974-90852f00e93a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.324289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5563-0745-41ea-a974-90852f00e93a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.324633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e5563-0745-41ea-a974-90852f00e93a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.326109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 245/470] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:52.333435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.333718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.333986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.335681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 226/471] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:52.358851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:52.360190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:52.412430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:52.449002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 246/472] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:52.476803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.548464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:52.601195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a3ea-475e-4e34-bc13-a0f1215391e4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.642556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.643189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.643487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.643755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.654976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.656478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fbe3bc20-2e0b-4642-a041-8cd1e71e48d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:52.673614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:52.674524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:52.675921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:52.675921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:52.675921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:52.675921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 227/473] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:52.681620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.701800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba59d4-6a17-4336-99ee-75c031d429e7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.702392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba59d4-6a17-4336-99ee-75c031d429e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.702807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba59d4-6a17-4336-99ee-75c031d429e7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.704931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 228/474] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:24:52.710779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.711220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.711582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.752306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:52.754145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:52.790387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eecd5-0844-40c1-8f1f-b58a753f2755 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.826588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.827207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.827510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.827781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.828508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:52.828815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.830623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.843158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 247/475] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:52.848736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:52.887901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:52.954478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdebcd-c7cf-478f-86ff-7bfa56ae213d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:52.959997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 229/476] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:52.989878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:52.990531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:52.990806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:52.991078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:52.991829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:52.993326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:52.995448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:53.016528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 248/477] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/users => generated 249 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:53.118650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:53.204986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eba45-d946-44d3-8009-43a81d59bd0f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:53.256898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:53.257523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:53.257805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:53.258076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:53.258745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:53.260424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:53.274438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.sql.core [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:24:53.274438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 20:24:53.274438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [parameters: {'id': '7a2909a361cc4977a124c5fbb22f4bba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 20:24:53.274438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80187) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result.read() Aug 06 20:24:53.292110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return ref.to_dict() Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:24:53.292987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application yield resource Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise self.value Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application session.commit() Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:24:53.293896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:24:53.296752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:24:53.299488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result.read() Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:24:53.301599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [parameters: {'id': '7a2909a361cc4977a124c5fbb22f4bba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:53.303661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 20:24:53.305680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:53.307815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 230/478] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 20:24:52 2022] POST /identity/v3/roles => generated 144 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:53.307954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:53.402402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:53.418968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6024bd2-e977-49f3-8eac-3412ce8cbb2f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:53.453398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:53.454663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:53.455126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:53.455685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:53.466847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a1154bdf-e3f9-41d8-a705-a0f185b2636b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:53.472354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:53.473214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 20:24:53.474020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:53.476612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 249/479] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:53.482843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:53.589570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233ec8e-a84f-4df1-9920-e5a69756871e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:53.600723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:53.628081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:53.628801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:53.629076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:53.629342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:53.630003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:53.630296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:53.631689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a640d6-d61c-419b-bdf3-07a9c1574c1f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:53.640503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 231/480] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:54.702505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab45e-abfe-4288-bd99-f029c7a853b0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:54.703556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab45e-abfe-4288-bd99-f029c7a853b0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:54.704028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab45e-abfe-4288-bd99-f029c7a853b0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:54.706238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 250/481] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:54.712746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:54.713719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:54.714183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:54.744145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:54.744804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6699-dfd0-4b50-8ebd-5f204575429f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:54.745088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6699-dfd0-4b50-8ebd-5f204575429f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:54.745363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6699-dfd0-4b50-8ebd-5f204575429f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:54.746295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:54.746921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 251/482] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:54.751910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:54.752193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:54.752469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:54.792305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:54.793526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:54.833597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 232/483] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:24:54.856242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:54.909513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 252/484] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:54.955864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:54.956703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:54.960047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c0307-a32d-48d0-a65e-f958f537534f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.001758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.002379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.002649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.002911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.020238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:55.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:55.025771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:55.026937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 233/485] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:24:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:55.035300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.090039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.111540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4dac-fc14-450f-84e0-d31e01eabd95 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.148823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.149551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.149875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2c871-e56e-4103-b050-97819a7bc73d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.150031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.150270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.161820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-844cb617-e9ce-404b-82c7-c10438b97912 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:55.166971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:55.168823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:55.170915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 253/486] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:24:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:55.172594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c82f2-5e6e-4c56-9d94-0b0022eeb771 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.172594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c82f2-5e6e-4c56-9d94-0b0022eeb771 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.172594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c82f2-5e6e-4c56-9d94-0b0022eeb771 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.177977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 254/487] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:55.178633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c82f2-5e6e-4c56-9d94-0b0022eeb771 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.189260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.190229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.190509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.190781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.191826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:55.192416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.193960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6a77e-a73d-40dc-9377-87bbeed59d3a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.204923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 234/488] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:55.206489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.207065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.207366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.229948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:55.231369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:55.250058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.303370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c82f2-5e6e-4c56-9d94-0b0022eeb771 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.327524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 235/489] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:55.327524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.367389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.369255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.369972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.370566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.372233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:55.373119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.374968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.387391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 255/490] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:55.388722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.392534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.460936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb7de-ac3d-44e3-964b-28ed012af7dc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.504094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.504955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.505364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.505896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.512474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7c40f-6f04-40b3-ac89-abe2d5a31e70 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.518751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.521462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:55.539745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:55.540795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:55.541613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:55.541613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:55.541613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:55.542111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 236/491] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:55.543019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.545912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.555060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.555962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.556444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.556889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.571479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:55.578285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:55.579163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:55.580229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:55.582556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 256/492] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:55.583689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.661880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.666800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f87a0f-a634-4b2b-967d-7322d90326d2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.703292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.703917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.704188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.704934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.708093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613404a-cab7-4291-b2a6-356968c35aac None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.715453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.716892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:55.730968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:55.731951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:55.732794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:55.732794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:55.732794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:55.735380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 237/493] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:55.736875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.745701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.746305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.746586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.746857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.747520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:55.747821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.749205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb54bcc-7ec5-4ccd-8091-1c1b8983d098 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.762324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 257/494] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:55.763447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d03e6-d4be-4222-998a-55eb28a7a1ab None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.763733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d03e6-d4be-4222-998a-55eb28a7a1ab None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.764041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d03e6-d4be-4222-998a-55eb28a7a1ab None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.769197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 258/495] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:55.769197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d03e6-d4be-4222-998a-55eb28a7a1ab None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.800032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.851561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c16b46-e18b-4e13-a6f3-8c0fa44e7204 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.884900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.885499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.885772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.886035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.886681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:55.886975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.888367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.889141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d03e6-d4be-4222-998a-55eb28a7a1ab None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:55.896140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 238/496] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:55.896930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:55.918109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:55.931776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:55.932375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.932645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.932911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.933542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:55.933839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:55.935191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca6440-16fc-4089-841b-6c0784154493 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:55.948315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 259/497] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:55.949536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:55.949821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:55.950096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:55.968920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:55.970119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:56.006946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7d26f-d9d9-4099-a189-28b242e964b8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.024721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.051266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 260/498] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:56.051266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.052485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.053109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.053380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.054035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.063867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.066576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:24:56.080741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:56.081733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:56.083191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 239/499] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:56.089717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.157372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1b21f-3108-4b66-abf3-540d857e7279 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.171114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.194076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9a741-79e8-49d3-836b-0be94fe80fba None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.194686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.195336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.195609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.195870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.205963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.208135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:56.223437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:56.224510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:56.225336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:56.225336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:56.225336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:56.225336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 261/500] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:56.225336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.237124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.237976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.238255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.238573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.247049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.248547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:24:56.261029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:56.261942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:56.262823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 240/501] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:56.263412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.298807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.330066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0412bd4-d196-4834-adee-050bd12b71ba None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.364357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.364971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.365241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.365511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.368228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226e35b-068e-4d6e-b4c3-d433d957294c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.375828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:24:56.381489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:56.382525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 262/502] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:56.383585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.405669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.406261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.406532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.406796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.407564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:56.407833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.408157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.409747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947f33c-17d1-4abf-904d-2199cf963b60 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.447012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 241/503] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:56.448210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b09b-7e82-4f17-860a-eaea747c3fa0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.448494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b09b-7e82-4f17-860a-eaea747c3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.448768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b09b-7e82-4f17-860a-eaea747c3fa0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.449999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 242/504] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:24:56.450679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865b09b-7e82-4f17-860a-eaea747c3fa0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.485435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f7ec8-5917-4bbb-8667-12ccec798c86 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.521731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.522360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.522641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.522908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.523574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:56.523870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.525252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.536635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 263/505] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:56.537397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.541644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.549469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865b09b-7e82-4f17-860a-eaea747c3fa0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.584744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.585344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.585623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.585895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.586616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:56.586919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.588389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.607489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 243/506] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:56.608295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.624742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.641058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9df027-a611-4b67-a6fc-6722743e0d58 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.674792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.675998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.676290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.676563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.677226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:56.677522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.678899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38f607-9605-4962-a811-ea5367c101c2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.686601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 264/507] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:56.687750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.688031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.688305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.705793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:24:56.706010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40406e79-b4f5-4b9d-863c-68eec26d7ed4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.706939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:24:56.740228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.740827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.741104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.741369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.762275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.771876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 265/508] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:24:56.772688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.809472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.810913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.848799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:56.871766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08b75-92ae-47ae-95c4-a03548a849b6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:56.905649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 244/509] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:56.906169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:56.906462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.906860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:56.907135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:56.907427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:56.915221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:56.916720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:24:56.929697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:56.930708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 266/510] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:56.931760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:56.961058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.007121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565ceff-f056-4ed9-a43c-1c997737e064 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.029414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752d3b2-49e0-45c4-8063-a143eaf93745 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.040886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.041480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.041757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.042027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.061793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.062477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.062749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.063014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.065617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.074892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.076376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:57.090779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:57.091835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:57.092665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:57.092665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.092665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:57.092665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 267/511] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:57.092963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.112942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.114650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.163723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.190649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e11d-7e2b-47fa-b143-5e44a1413e13 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.212709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 245/512] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:57.213457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.224070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.224692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.224965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.225237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.235707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.237153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:57.251471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:57.252538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:57.254153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:57.254153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.254153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:57.254153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 268/513] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:57.254153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.295415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.312747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9c0b0-aa74-4d65-abcb-dc8507057f85 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.347881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.348586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.348862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.349131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.353685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7d3b0-7949-4d64-9d1d-ca7e8b97606b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.358897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.360385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:57.374785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:57.375770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:57.377729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:57.377729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.377729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:57.377729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 246/514] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:57.377729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.382241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.386907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.387929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.387929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.388104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.388765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:57.389063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.390462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.428229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 269/515] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:57.429082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.487811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bb442-8729-4017-9d2e-9542e90d6aaf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.523869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.524470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.524768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.525004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.525320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.525633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:57.525933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.527558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.529050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f371353b-7ddb-4766-946b-0c1900e08da2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.539176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 247/516] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:57.539986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.568248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.568868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.569143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.569407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.580227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.581763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:57.596606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:57.597514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:57.598376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:57.598376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:57.598376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:57.598376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 270/517] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:57.598606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.604808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.642432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1d87a-7125-4fd9-af96-4cf570cf2a2a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.677100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.677690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.677961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.678223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.678844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:57.679141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.680508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.691272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 248/518] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:57.692262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.701764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b1b7b-3eaa-4781-b78a-94ea8d214d7e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.736010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.736608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.736888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.737168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.737808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:57.738781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.740150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.752186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 271/519] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:57.753036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.766489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.798604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9a88a-280f-470d-9ac7-be784569b312 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.820749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:57.832488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.833079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.833348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.833609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.856475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f8c5d-af0e-4cdf-9bf8-3eb30cf432b6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:57.889056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:57.889768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:57.890048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:57.890323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:57.897718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.899141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.899887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:57.901311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:24:57.911151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:57.912240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 272/520] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:57.913227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:57.980026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.002127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 249/521] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:58.002866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.010527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417917f-83d0-4097-bf72-6bd1e237bea1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.029726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.043971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.044571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.044851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.045121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.045759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:58.046061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.047467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.061623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 273/522] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:58.062455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.108903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862094-3882-4a8a-a61d-4f7a0823e248 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.142388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.142983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.143344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.143546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.144165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.145586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.163672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8328b-dce1-4932-a866-a49ff5c8d567 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.165809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 250/523] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:24:58 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:24:58.166674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.197168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.205010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.205754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.206033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.206319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.213720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.215222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:24:58.228548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:58.229642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 274/524] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:58.235661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.264968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.290079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445482-bbc6-4d15-8200-aba5a7638906 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.333135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.333993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.334105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.334346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.336234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:58.336234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.337638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.350605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89ab86-d5ed-4397-a59f-8d1898a2deeb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.358759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 251/525] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:58.359651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.390064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.390761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.391009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.391301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.402638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.404165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:58.419181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:58.420135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:58.421038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:58.421038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:58.421038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:58.421038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 275/526] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:58.421675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.466536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2b3e-8257-4bfe-b641-fa71a178e48d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.475941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.505102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.506096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.506597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.507063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.514436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.516364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.518581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:24:58.531014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:58.532191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:58.533060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 252/527] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:58.533599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.544262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81144c6c-830d-4ca2-81a8-1f1a8045944a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.580697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.581304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.581580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.582402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.583095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:58.583421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.584848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.606374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 276/528] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:58.607225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.651407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993a5ea-a7d4-4aee-ada7-f174852ea856 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.688682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.689285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.689560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.689828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.714851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eb74-d3e2-4696-b787-4dae35234bd3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.716551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.757602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.761000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.761616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.761897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.762171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.762408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.762814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:58.763125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.764545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.764844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.778180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 277/529] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:58.778916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.873542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 253/530] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:24:58.874405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.888958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c01f00-4464-41a6-acfe-0dcc9e7b1f99 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:58.923207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:58.923837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:58.924117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:58.924387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:58.925079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:58.925428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:58.926835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:58.938689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 278/531] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:58.939522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:58.964761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.986137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:58.990540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cd017-ec28-4020-b824-827d31dfac46 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.023192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.023813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.024084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.024352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.025046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=165e5c1de12b448d92f5563e600bda2b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:59.025352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.026773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.032071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 254/532] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/role_assignments?user.id=165e5c1de12b448d92f5563e600bda2b&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:59.032768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.076826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fa62-8aad-4291-96dc-4b5d12f493aa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.123913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.124550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.124822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.125087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.132679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.134161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:24:59.146431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:59.147370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:59.148204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 279/533] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:59.148652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.162899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5f013-3d71-49bd-bfb7-ba01e31cf880 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.210882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.211373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.211656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.211922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.225499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.227871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.242993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:24:59.248455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:59.249318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:24:59.250153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:24:59.250153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:24:59.250153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:24:59.250153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 255/534] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:24:59.250799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.265479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e1cfc-ef37-431d-b513-009e1a44410c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.280438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:59.313756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.314528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.315174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.315486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.316897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:59.317205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.319370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.327267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 280/535] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:59.328244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.393951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b11d4-2b68-49b0-b95d-1e1ece794891 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.446763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.447826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.448108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.448383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.449097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:59.449406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.450907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.459422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2b28-c8de-4b3e-ad89-7f2d8479cbcd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.476437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 256/536] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:59.487417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.534519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.535188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.535485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.535749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.536394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:59.536691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.538068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.559546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 281/537] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:24:59.564976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.582744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:59.595321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:24:59.627743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd3ff0-a459-4b0f-81e7-5ac1eb9b69ee None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.668858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.670623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.671159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.671787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.673617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=29f9cc8a29c4481491d319883cab7056) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:24:59.674942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.677312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.690507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 257/538] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/role_assignments?user.id=29f9cc8a29c4481491d319883cab7056&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:24:59.762956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a570600-3ccb-4b23-bfed-98700350c6cf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:24:59.814430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:24:59.815529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:24:59.816072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:24:59.816540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:24:59.829321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:24:59.831487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:24:59.846753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:24:59.848308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:24:59.849129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:24:59.852826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 282/539] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:24:59.854128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:24:59.985360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e174e-157c-471b-b894-2b70ee1eda1a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:00.043906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:00.044555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:00.044838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:00.045109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:00.045806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:00.046114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:00.048243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa62009-7341-4941-98c9-2d7c92929e6e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:00.062200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:00.069077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 258/540] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:00.074941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:00.175645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:00.206320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f515c3-55cb-49ad-a498-0a11fa64eecd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:00.242789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:00.243436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:00.243719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:00.243992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:00.244720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=21d525a5c45e472e8e5f56d15b43df0b) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:00.245028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:00.246533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12463594-c7c7-4830-b8e1-5c99e7c83ec6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:00.252522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 283/541] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:00 2022] GET /identity/v3/role_assignments?user.id=21d525a5c45e472e8e5f56d15b43df0b&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:00.653532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb61-246e-4341-a261-14952eff8dee None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:00.653855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb61-246e-4341-a261-14952eff8dee None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:00.654079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accfb61-246e-4341-a261-14952eff8dee None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:00.655678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 259/542] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:00.661298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:00.661595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:00.661877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:00.682727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:00.684016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:00.776862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 284/543] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:00.813092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfb61-246e-4341-a261-14952eff8dee None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:00.947994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accfb61-246e-4341-a261-14952eff8dee None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:00.996816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:00.997450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:00.997698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:00.997962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.012985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:01.017619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:01.018494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:01.019846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:01.020438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 260/544] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:01.025334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.112259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:01.165036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ba36b-1beb-4c21-b077-b307e1756f09 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:01.205579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:01.206108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.206381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.207222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.207912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:01.208207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:01.209566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:01.217866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 285/545] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:01.223591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.292907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:01.334815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9f96f-8771-436c-90e5-0f63a3942998 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:01.368057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:01.368661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.368935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.369202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.379810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:01.381253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-676d10ec-f06a-4f9e-a384-fc44dd81a4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:01.396153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:01.397044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:01.397865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:01.397865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:01.397865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:01.397865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 261/546] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:01.404453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.565043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317c6e5-8a91-497e-a263-0763598701a4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:01.611609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:01.616481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849836-5b6b-4534-af57-a6df27c33f22 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.616766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849836-5b6b-4534-af57-a6df27c33f22 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.617034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6849836-5b6b-4534-af57-a6df27c33f22 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.618482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 262/547] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:01.620242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:01.620854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.621147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.621449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.622101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:01.622401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:01.623889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:01.625126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.625742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.626212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.644488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 286/548] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:01.646041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:01.647750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:01.649949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.758665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e4616-96a8-4b3a-97ec-c8bc7bbb6608 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:01.795718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:01.796448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:01.796732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:01.797064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:01.801080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 263/549] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:25:01.805080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:01.806559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:01.818995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:01.820356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:01.821496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 287/550] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:01.826295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.835020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:01.914693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:01.915758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:01.980840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4c1ed-3f1b-451a-99df-26d1f7ed6b9f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:01.988494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84a942-a270-41dd-a95b-2fb692db22ba None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.017293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.018594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.019197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.019699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.020614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:02.021132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.022887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4951-45b4-47a5-9ded-885997a772d0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.026367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.026584 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.026848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.027128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.038909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:02.046826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 264/551] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:02.046967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:02.047850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:02.049829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 288/552] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:02.051605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.051918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e246-c93b-48a7-911e-92a0c2fd7033 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.052480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e246-c93b-48a7-911e-92a0c2fd7033 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.052940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86e246-c93b-48a7-911e-92a0c2fd7033 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.054635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 265/553] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:02.055647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e246-c93b-48a7-911e-92a0c2fd7033 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.158060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.164128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86e246-c93b-48a7-911e-92a0c2fd7033 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.164611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc0c08-8c7c-4389-b7cb-18295a2bd00d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.166280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.203065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.203334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.203704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.203987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.204261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.205248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.205716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.206192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.207228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:02.207750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.210131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83da9c6-adae-4d73-9472-f670f0eb62e7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.220503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 266/554] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:02.221987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7709-4151-4f40-b558-953f4f31bc5a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.222966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7709-4151-4f40-b558-953f4f31bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.223462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed7709-4151-4f40-b558-953f4f31bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.242392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-25ed7709-4151-4f40-b558-953f4f31bc5a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:02.243609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-25ed7709-4151-4f40-b558-953f4f31bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:02.281320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.282831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb0d10-eb6a-452c-aa25-2fa3570fe4fa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.309691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 267/555] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:02.310954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077efd8-c9d3-4aac-ab60-646c0418abfe None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.311258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077efd8-c9d3-4aac-ab60-646c0418abfe None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.311539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077efd8-c9d3-4aac-ab60-646c0418abfe None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.312944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 268/556] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:02.317670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077efd8-c9d3-4aac-ab60-646c0418abfe None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.403670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 289/557] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:02.405533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.406036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.406519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.413019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.429323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:02.430572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:02.431117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.443865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077efd8-c9d3-4aac-ab60-646c0418abfe None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.479781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.480422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.480693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.481000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.491577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.493080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.505486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 290/558] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:02.506415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:02.523797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:02.524933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:02.526010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:02.526010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:02.526010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:02.526010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 269/559] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:02.526010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.636586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303471ff-2cec-444f-9eb8-2e679aa34bbe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.646320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386e5fc-cbd5-4c2e-9a2b-5758132099d8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.669974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.676651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.677284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.677561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.677829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.683739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.684363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.684876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.684876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.690357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:02.695052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:02.695962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:02.696782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 291/560] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:02.697475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.702131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.703037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.705364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:02.719907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:02.720841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:02.721769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:02.721769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:02.721769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:02.721769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 270/561] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:02.721990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.809294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f99bc-195f-4284-be5b-d05006eea4d4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.823722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc20613-7458-4b21-94c9-89c17ad7094e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.842286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.842889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.843162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.843457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.844096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:02.844394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:02.845764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:02.856684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.857302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.857501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 292/562] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:02.857589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.857837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.858308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.868764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:02.873919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:02.875011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:02.875983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 271/563] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:02.876659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:02.917679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.928935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:02.964412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678dc7-4f54-4b40-beb6-2aec4d88d252 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.971363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6bbfa-ef37-4b1f-8e03-fcc92d16b068 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:02.997040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:02.997625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:02.997896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:02.998156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:02.998888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:02.999088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.000456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf0aff-7ec2-401c-9061-b10c052e4525 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.004987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.005667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.005944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.006216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.006843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.007143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.008507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.008601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 293/564] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.009752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8770f-faba-4358-8496-50f05cbb0122 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.010031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8770f-faba-4358-8496-50f05cbb0122 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.010301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8770f-faba-4358-8496-50f05cbb0122 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.015830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 294/565] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:03.016374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8770f-faba-4358-8496-50f05cbb0122 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.021058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 272/566] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.021856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.114701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8770f-faba-4358-8496-50f05cbb0122 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.118121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886703-5bef-4600-b2b8-691fee9b5bfe None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.129043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.132453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.149518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.150135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.150405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.150671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.153623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.154212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.154487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.154754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.155432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.155728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.157067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.158133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.159569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.164995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 273/567] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.165603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-08a8d283-c300-4def-a2dd-0716d30e0735 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:03.171266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.172662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:25:03.173778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:03.177248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 295/568] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.178403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.178684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.178997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.195901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:03.197069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:03.262028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08930-d051-4558-a614-3b278de191e4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.262846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 296/569] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:03.264032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.305291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.305942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.306219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.306487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.316696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.318114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:03.332361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.333306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:03.334205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:03.334205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.334205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:03.334205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 274/570] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.334205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.361747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.368411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdade86-d387-4bc6-a658-385022d0b4ed None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.370774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.402840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.403493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.403763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.404027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.411023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.412495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:03.423144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.424276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:03.425147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 297/571] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.425660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.439465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c215eb-f6ac-43e2-9c0f-c71f9e5cfcc8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.473818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691098c1-308b-4166-843a-2adde872246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.474439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691098c1-308b-4166-843a-2adde872246e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.474717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691098c1-308b-4166-843a-2adde872246e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.474984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691098c1-308b-4166-843a-2adde872246e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.485149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691098c1-308b-4166-843a-2adde872246e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.486647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691098c1-308b-4166-843a-2adde872246e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-691098c1-308b-4166-843a-2adde872246e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:03.500082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.501173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:03.502159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:03.502159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.502159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:03.502159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 275/572] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.502159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691098c1-308b-4166-843a-2adde872246e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.525272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18254848-7f7d-420a-b5f8-90e676c43c1c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.558529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.559128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.559434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.559709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.560424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.560726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.562143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.584817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 298/573] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.584817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.587205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.608065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.608328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691098c1-308b-4166-843a-2adde872246e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.641361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.641982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.642259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.642527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.652996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:03.658080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.659215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 276/574] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.660308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.686303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ca195-a42c-4611-8823-91984d62f084 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.720422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.720951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.721226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.721493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.722125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.722448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.723839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.734726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 299/575] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.735791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.759047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3568487-a22a-4bb0-a71a-f476d00dac09 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.791127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.791761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.792033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.792295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.792971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.793349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.794678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.804943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.809270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 277/576] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.810310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.823285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:03.842264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d84fc-6c3c-4170-963b-8caebc4bc0b7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.875376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.875972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.876247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.876511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.877139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:03.877433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.879446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.891011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 300/577] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:03.891892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.908475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685088-2700-4d9d-9652-dd459da58829 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:03.943706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:03.944328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:03.944609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:03.944880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:03.955038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:03.956531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:03.970518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:03.971500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:03.972926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:03.972926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:03.972926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:03.972926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 278/578] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:03.972926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:03.993276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaee88-a539-4f38-a1fb-02461ebd1658 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.023937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.027079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.027763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.028044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.028314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.028995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.029292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.030644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.038325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 301/579] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.039096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.043686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.075355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f18ca2-e6e2-4504-b36b-6d051fdaf327 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.107641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.108255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.108531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.108799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.116524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.117962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:04.129302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:04.130385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 279/580] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:04.131484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.142483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2a1a0-df44-4a4c-904b-43d0861d5d50 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.176330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.176968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.177316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.177640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.178422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=f493544ed09444499776046e5e36ec6a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.178798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.180320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.185573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 302/581] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/role_assignments?user.id=f493544ed09444499776046e5e36ec6a&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.186321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.240145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8417df-95a7-4013-a349-c23041243dfc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.254977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.279120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.280020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.281079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.281339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.281780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.292292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.294270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:04.307075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:04.308193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:04.309330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:04.310579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 280/582] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:04.311525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.325191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aba223-a263-4e55-91aa-4c2c8092a3fb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.362432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.363606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.363887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.364148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.364772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.365066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.366415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.378538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 303/583] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.379398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.423093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cddbc-f0a4-4b9e-adc3-0702c2a04b8c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.458434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.459064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.459355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.459629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.470702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.472159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:04.487475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:04.488998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:04.489837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:04.489837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:04.489837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:04.489837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 281/584] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:04.490069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.498665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673dcb5-2836-49ae-9031-f5965a94c825 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.517641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.527379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.536683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.537380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.537759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.538094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.538882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.539267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.540767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.558406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 304/585] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.559191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.607747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd307-546d-4132-a73b-a44a84530af2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.643511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.644777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.645053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.645320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.646039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.646375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.647814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.665814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 282/586] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.666617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.674942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc0c36-3298-4cc4-9c11-37c90acf33f5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.717746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.718371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.718646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.718911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.726209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.727690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:04.738655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:04.739540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:04.740421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 305/587] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:04.740917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.761402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.786551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6560-5547-4a3f-a778-d00b6aaec859 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.789767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:04.822468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.823161 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.823530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.823862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.824573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:04.824964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.826419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.843430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 283/588] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:04.843430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.854587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ccb12-72fd-4c14-b67f-905ba64be72b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.890752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.891410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.891693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.891963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.903085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.904587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:04.919861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:04.920833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:04.921697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:04.921697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:04.921697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:04.921697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 306/589] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:04.921697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:04.944915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7340e-2b84-4338-9f6a-b7eda8656e80 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:04.979079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:04.979731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:04.980009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:04.980281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:04.991315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:04.992916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:04.994788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:05.009006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:05.009963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:05.010829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:05.010829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:05.010829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:05.012453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 284/590] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:05.013186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.027268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.033096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5dc48-1044-46a6-b442-30d8decc8f65 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.067195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.067850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.068129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.068402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.069088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:05.069387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.070841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.084323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 307/591] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:05.085022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.123215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadfa52-f5a3-40dc-b3b7-90fd68dfef41 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.158019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.158639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.158915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.159187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.166867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.168337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:05.179493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:05.180506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 285/592] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:05.186152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.200455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-7107-4d93-9e89-cbb4638feb2f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.236156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.236757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.237036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.237331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.237971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:05.238269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.239663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.242968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.255689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 308/593] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:05.255689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.273706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.299279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da1049-730f-47cd-b46c-b5321bdd5eec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.334993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.335631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.335927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.336187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.336823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:05.337123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.338483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.350051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 286/594] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:05.350858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.368912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743433b-4744-402d-8e04-4b20670011e4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.404429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.405160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.405506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.405844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/165e5c1de12b448d92f5563e600bda2b/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.420967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=165e5c1de12b448d92f5563e600bda2b, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.422609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.447273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 309/595] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:05 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/165e5c1de12b448d92f5563e600bda2b/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:05.447273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.471951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde921-6eb5-4997-8d2e-55624b50097f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.491262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.520470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.521206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.521605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.521942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.522933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:05.523534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.525479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.549341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 287/596] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:05.550506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.555865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.620335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0f439-57fa-458e-a590-7d9a815d82c7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.671278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.672290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.672712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.673134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.673478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d217-cb46-41f2-a121-5e63b3f6ec59 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.682408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.684196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:05.701529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:05.702599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:05.703674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:05.704829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 310/597] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:05.710184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.724427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.725078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.725612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.725882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.734224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.736100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:05.750222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:05.751460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 288/598] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:05.757715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.795759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.837844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce45ab7-e47a-4ed6-a754-9ba31ccadee4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.867591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:05.877906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.879036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.879498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.879838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.889120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2baaa-dd62-419e-8b69-89f0ec818617 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:05.891745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.893373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:05.910146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:05.911300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:05.912355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:05.912355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:05.912355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:05.916809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 311/599] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:05.917690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:05.933766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:05.934850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:05.935761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:05.936175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:05.937265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:05.937952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:05.939938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:05.956260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 289/600] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:05.958875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.030023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ad2b-318e-4bc2-9607-e3f3dd615ab0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.067469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.068361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.068739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.069111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.070023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:06.070427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.072082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.073603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.083894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d4242-ffb8-4996-a94e-d635aaf71b76 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.087995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 312/601] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:06.089046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.128273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.130777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.131328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.131865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.132866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:06.134294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.135896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.141395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.152255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 290/602] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:06.153760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.213902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51ec5c-ee94-4aec-b814-ebe5283be87c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.255671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.256697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.257191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.257567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.272639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=54e2221204ff4332ba980b9c5779b05c, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.272953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23f58f-6989-4689-902c-92f2cf570e66 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.274372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.295729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 313/603] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:06 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:06.297141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.312153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.312887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.313229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.313566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/29f9cc8a29c4481491d319883cab7056/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.332601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=29f9cc8a29c4481491d319883cab7056, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.334231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa706-2ee2-4d3a-822b-470be511508c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.358710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 291/604] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:06 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/29f9cc8a29c4481491d319883cab7056/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:06.358710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6843-3a94-4439-857b-d40d7739acce None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.358710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6843-3a94-4439-857b-d40d7739acce None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.358710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6843-3a94-4439-857b-d40d7739acce None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.363624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 292/605] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:06.364150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.364435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.364708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.375856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.405357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:06.406628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:06.460602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.474144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f38496-c734-40fa-817b-2d1b09e761e9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.515485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.516047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 293/606] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:06.516162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.516395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.516665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.525106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.526596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:06.540148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:06.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:06.541947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 314/607] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:06.547160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.547503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.663059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dba767-5ee1-4749-a5fa-527fde4c0d23 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.683474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa20665-1965-4fa6-a156-a97502f570ce None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.696468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.702714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.703642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.704146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.704858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.716164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:06.721681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:06.723331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:06.724404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:06.726302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 294/608] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:06.733763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.734569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.734966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.735133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.735681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.736513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:06.736955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.739491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.753576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 315/609] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:06.760230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:06.774987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:06.874034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c521-17b3-48df-8a06-cd806a739e45 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:06.915896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:06.917295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:06.918071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:06.918972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/21d525a5c45e472e8e5f56d15b43df0b/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:06.941411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=21d525a5c45e472e8e5f56d15b43df0b, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:06.943324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:06.964945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 316/610] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:06 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/21d525a5c45e472e8e5f56d15b43df0b/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:25:06.987945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a121e-7a66-4881-81df-703d87eb3bf2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:07.029483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:07.030354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.030821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.031233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.032104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:07.032547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:07.034096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:07.045124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 295/611] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:07.052481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:07.117341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:07.162782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b7578-ede2-4201-b43f-dc9c4a40af28 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:07.199904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:07.200780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.201205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.201636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.212870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:07.214608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:07.232685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:07.233857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:07.234938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:07.234938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:07.234938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:07.236661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 317/612] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:07.244321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:07.307638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:07.361257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0f17-4302-4260-820c-6847eb01d621 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:07.416555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:07.417085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.417360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.417628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.418265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:07.418560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:07.419926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:07.436295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 296/613] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:07.441916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:07.580765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded100-3c7d-46ce-b7d6-c63476864fac None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:07.599762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:07.627151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:07.628159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.628699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.629165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.641296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:07.642978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8b009566-10c5-439a-a5e1-fda8cd24382c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:07.663510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:07.664454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:07.665352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:07.667661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 318/614] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:07.673365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:07.765379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a8def-08ad-4738-ad49-f311acf97858 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.766015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a8def-08ad-4738-ad49-f311acf97858 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.766592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a8def-08ad-4738-ad49-f311acf97858 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.769053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 319/615] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:07.777077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.777705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.778353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.813810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:07.815831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:07.836136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97aca52-2813-4ce2-8fdb-aeba01be27f6 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:07.851596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:07.896561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:07.897165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:07.897454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:07.897704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:07.898424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:07.898721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:07.900191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:07.938725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 297/616] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:07.941720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:07.943888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 320/617] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:07.966937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.094926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3ce84-645a-4c41-ba67-2ee74b4b4184 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.134119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.134794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.135072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.135375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.147028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.149006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.157973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268be5-cf78-43a4-9e2b-af7286412783 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.159771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:08.165594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:08.166502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:08.167439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:08.167439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:08.167439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:08.167439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 298/618] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:08.176236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.199353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.199908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.200183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.200464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.211832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:08.216872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:08.218248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:08.219073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 321/619] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:08.224957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.245243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:08.366027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738e46d-f19b-4501-a599-b56da0afaebc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.415972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85934d9-1fb2-48eb-bc24-f584de78604e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.438184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.439024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.439341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.439614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.440280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:08.440580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.441989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.450980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 322/620] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:08.460208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.471794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.472974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.473254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.473522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.474166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:08.474464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.475856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.488621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 299/621] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:08.494560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.523593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:08.629715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:08.642225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b63f2-0353-441d-9961-a593f0969bc1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.669405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799c64-3cdd-478f-990b-6909357b1b6d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.677047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.677824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.678204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.678576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.689565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.695281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:08.707236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:08.708307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:08.709351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:08.709351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:08.709351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:08.711579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 323/622] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:08.719265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.742375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.743009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.743309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.743586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.760756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.762221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:08.781831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:08.782767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:08.783658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:08.790946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 300/623] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:08.791832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.854578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:08.877985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3489ec-27ab-4837-8c88-da2fd58c4572 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.915778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39883572-f152-464e-a378-e77f4a276958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.916383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883572-f152-464e-a378-e77f4a276958 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.916656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883572-f152-464e-a378-e77f4a276958 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.916924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39883572-f152-464e-a378-e77f4a276958 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.917564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883572-f152-464e-a378-e77f4a276958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:08.917864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883572-f152-464e-a378-e77f4a276958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.919221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39883572-f152-464e-a378-e77f4a276958 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.931687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 324/624] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:08.933656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da995c2-a1a8-444c-a62a-ed2432b5d59f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:08.937331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b039b-5855-40e2-93b4-6967742cffae None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.937615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b039b-5855-40e2-93b4-6967742cffae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.937887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b039b-5855-40e2-93b4-6967742cffae None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.939131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 325/625] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:08.940172 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc33ab-cab4-4b3a-a6b7-75a6725c22f3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.940444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc33ab-cab4-4b3a-a6b7-75a6725c22f3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.940712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc33ab-cab4-4b3a-a6b7-75a6725c22f3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.947371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 326/626] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:08.948320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc33ab-cab4-4b3a-a6b7-75a6725c22f3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:08.975487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:08.976015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.976294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.976568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:08.977242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:08.977544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:08.978966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4084d-5e32-4bb7-a267-66031588f64a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:08.996969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 301/627] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:08.996969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97de4-3763-4710-ac5c-28e8ca58a188 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:08.996969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97de4-3763-4710-ac5c-28e8ca58a188 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:08.996969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97de4-3763-4710-ac5c-28e8ca58a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.001984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.013673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c5d97de4-3763-4710-ac5c-28e8ca58a188 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:09.014873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c5d97de4-3763-4710-ac5c-28e8ca58a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:09.061677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc33ab-cab4-4b3a-a6b7-75a6725c22f3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.095381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 302/628] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:09.097213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.097571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.097912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.098803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.099650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.100098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.100536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.104081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.109443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.110934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.119963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:09.121155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:09.123368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:09.124289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 327/629] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:09.127073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.193514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 303/630] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:09.194762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.246533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d23ba-dea9-48f5-ac16-9abe34b7c421 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.268110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.281489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.282372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.282716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.283638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/f493544ed09444499776046e5e36ec6a/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.299883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=f493544ed09444499776046e5e36ec6a, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.301353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.311720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631e2a0-3c4d-4c4c-b797-04de0a5e9f6d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.316687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 328/631] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:09 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/f493544ed09444499776046e5e36ec6a/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:09.317802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.354978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.355778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.356098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.356426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.369115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:09.374388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:09.375417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:09.376240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:09.379752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 304/632] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:09.380723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.399048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.471713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e63b5-6767-45a5-b0cf-f4f7e93f58b6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.514663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.515593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.516054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.516608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.517630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:09.518112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.520374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.520486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512e7e-9a40-4a37-9f0d-e000100b6d72 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.539643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 329/633] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:09.545173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.546134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.556265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e417f-5515-429d-8495-358eff6f648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.556887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417f-5515-429d-8495-358eff6f648d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.557159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417f-5515-429d-8495-358eff6f648d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.557423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e417f-5515-429d-8495-358eff6f648d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.568671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e417f-5515-429d-8495-358eff6f648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-765e417f-5515-429d-8495-358eff6f648d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:09.573290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:09.574211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:09.575055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 305/634] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:09.575792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241bb2-d8ad-4611-91e6-929de7eb8950 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.575792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241bb2-d8ad-4611-91e6-929de7eb8950 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.581502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241bb2-d8ad-4611-91e6-929de7eb8950 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.581502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 306/635] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:09.582293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241bb2-d8ad-4611-91e6-929de7eb8950 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.665051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8727a-d79e-45d0-b2ab-896f4d110c79 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.668496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.694013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241bb2-d8ad-4611-91e6-929de7eb8950 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.702467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.703145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.703527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.703867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.704600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:09.705215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.706763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.719903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 330/636] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:09.719903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.735699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.736299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.736656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.736923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.792477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.811977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.813448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.825515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82c31-0d0d-4ad8-8362-c8a2c96f68c8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:09.864147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:09.864752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.865034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.865305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.865963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:09.866267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:09.867752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e2b02-80d0-43ad-9d7b-1c6a58d9b201 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:09.876229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 331/637] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:09.880858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:09.881252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:09.882091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:09.900103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:09.901417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:09.921087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 307/638] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:09.921087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:09.931578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:09.978501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 332/639] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:09.979557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.022274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.041115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe4a1d-01a1-4032-9029-08ed7be84318 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.075595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.076219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.076492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.076754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.087218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.088665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.096324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b373ab1-3c9e-4211-987c-988bdf59cb78 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:10.102753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.103927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:10.104875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:10.104875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.104875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:10.104875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 308/640] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.105095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.138294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.139366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.139827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.140153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.151150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.152616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:10.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.169217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:10.170084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:10.170084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.170084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:10.170084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 333/641] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.170300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.182888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.210093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60289e9b-df46-460d-9f37-dce77ddd256a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.245529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.246438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.246912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.247423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.251483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.260553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.261977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.276081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35c42-c3be-495f-a263-c61a323b363c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:10.276622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.277839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:10.278755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:10.278755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:10.278755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:10.278755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 309/642] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.278755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.317384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.318134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.318375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.318671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.329587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:10.335801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.336914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:10.337975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:10.341614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 334/643] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.342451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.391086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b1bf8-d6d1-4a74-816f-e3d48ba35a40 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.417145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.425185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.425822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.426094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.426387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.427064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:10.427391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.429271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.445318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 310/644] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:10.446189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.468242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2797-e75d-443e-8d64-a41d88f62387 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.499140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.505431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.506322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.506818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.507357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.508182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:10.508678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.510224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.524064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 335/645] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:10.525079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.557496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae108a9-6645-4caa-b851-f166f9f45290 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.595007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.595625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.595825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.596090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.599315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:10.599315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.599315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.616031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 311/646] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:10.616031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.641501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9cc9fb-fc2d-4bf4-a95d-66a8e8fad687 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.673047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.680187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.680796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.681088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.681340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.682302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:10.682302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.683684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.697327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 336/647] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:10.697327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.720801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d470b-8274-4515-ba6d-dd24ed12ab87 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.729714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.755867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.756596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.756936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.757279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.765359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.766782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:10.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.784349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 312/648] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.785423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.816697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a82c-45b2-4640-a0c1-60a90641ca1e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.850932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.851500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.851773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.852035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.860686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.862511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:10.876141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.877060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 337/649] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.883486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.888251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f1b57-c2c7-49b1-871b-a0997fb47814 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:10.922851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:10.923651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:10.923931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:10.924201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:10.931412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:10.932851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:10.943920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:10.944835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:10.945714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:10.946136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:10.946207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 313/650] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:10.946207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:10.984443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.000867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae341b78-a98b-4d2c-9d6f-f1460f64df78 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.036209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.036824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.037102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.037368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.048313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.049746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.061413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d8223-057c-49e9-8e0d-35a64d2ce100 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:11.063725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:11.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:11.065531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:11.065531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:11.065531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:11.065531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 338/651] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:11.065531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.104023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.104930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.105390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.105838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.106736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:11.107220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.108856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.131657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 314/652] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 20:25:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:11.131657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.183656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfffa6-b945-4171-8529-fbc24a66cb5d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.186856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.215131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.222888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.223559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.223832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.224146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.224815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:11.225114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.226529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.231833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fd3d0-6536-4e32-bd68-09af487084a4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.245503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 339/653] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:11.250347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.268721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.269853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.270132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.270407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.271088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:11.271428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.272857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.289828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 315/654] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:11.289828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.368331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27f42a-ca84-4ff4-8c05-ee95316a2dc6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.387063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f70cd-1c60-43fd-b0ec-25d25a547571 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.401397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.401990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.402260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.402523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.403152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:11.403477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.404834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.416134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 340/655] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:11.416901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.424570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.425175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.425498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.425770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.440921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.441811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.495737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.497178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.515579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8dd667-afd4-4ab4-8206-9bea58336761 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.548615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.549225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.549507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.549776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.593520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 316/656] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:11.594354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.624175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.625542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4c899-c2c1-4195-a2db-1e4ba6df38ba None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.640326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.651756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.695957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f8263-9632-44b9-8a63-e7b6422c5f75 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.727871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 341/657] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:11.728599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.729245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d361e2-0a5f-45d0-bda7-6cdef547c77f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.729529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d361e2-0a5f-45d0-bda7-6cdef547c77f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.729627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.729789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d361e2-0a5f-45d0-bda7-6cdef547c77f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.730148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.730551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.731000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 342/658] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:11.731588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=165e5c1de12b448d92f5563e600bda2b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:11.731713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d361e2-0a5f-45d0-bda7-6cdef547c77f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.732172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.733592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.740614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 317/659] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/role_assignments?user.id=165e5c1de12b448d92f5563e600bda2b&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:11.741417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.857843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed74c-2f23-4678-a420-b77ed7ef7916 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.862352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d361e2-0a5f-45d0-bda7-6cdef547c77f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:11.869802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.889574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:11.899172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.900236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.900236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.900415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.906380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:11.906529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.906746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.907011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.914368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.915906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.916632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:11.918093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-400b2829-594d-4597-adb7-db40790df7c0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:11.928788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:11.929913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:11.931103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 343/660] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:11.931761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:11.931761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:11.931761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:11.933932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:11.936170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:11.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:11.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:11.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:11.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 318/661] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:11.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:11.951596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:11.952796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:12.035422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 344/662] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:12.035422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.053165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2eacab-af6d-48a0-9495-7dc85770b8a2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.089330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.089955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.090224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.090494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.101804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.103277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:12.118689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:12.119685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:12.120647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:12.120647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:12.120647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:12.120647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 319/663] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:12.120862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.138571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.148478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d03ada-6ea0-41b7-89b2-32e9d55a0c0a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.162046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.186190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.186787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.187062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.187360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.188077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:12.188375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.189857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.209792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 345/664] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:12.211594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.229485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb88d-d3ac-4fba-b867-ebb7ce0ed24f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.265132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.265735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.266014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.266281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.266908 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:12.267210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.268580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.284500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 320/665] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:12.284500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.362475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ac0d-0b6a-4004-906b-07fc3edf2b92 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.392463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.423604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.424160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.424437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.424706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.426979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09f2ff-54a9-4f86-a915-32adfcb371be None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.439074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:12.446060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:12.447162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:12.448420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:12.454728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 346/666] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:12.454728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.486168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.488398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.488694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.488971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.489624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:12.489992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.492014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.494549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.509142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 321/667] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:12.509994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.593084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09451ca-151d-4fa7-827a-9da4748c583d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.633813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01652a7-f851-4c08-9e5f-7c92ada2362e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.640344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.641054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.641395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.641754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.677817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.678362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.678646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.678912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.680934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.686712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.688642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:12.700526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:12.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:12.702295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:12.706590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 322/668] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:12.707948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.720469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.721942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.756206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.810453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d35c71-7aa4-4571-99c8-a91ecae629d4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.844601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 347/669] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:12.845427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.847314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.848248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.849455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.849889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:12.850691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:12.851144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:12.852669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:12.864393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 323/670] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:12.865440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:12.927643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.957653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de9e1-0515-4a5f-84c5-9047ec073e40 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.981254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0319d6a-f769-4985-87fd-1e41670cd46d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:12.987494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:12.994911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:12.995631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:12.995903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:12.996489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.002914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.005102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:13.016136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:13.016986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:13.017855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 348/671] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:13.018946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.022178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.022775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.023073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.023360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.024045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.024977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.025726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.043517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 324/672] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.043517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.137466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17dc24-cf73-4d8b-a049-5a2337852bc9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.147505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd978b0-397d-47d7-84e2-847f651faa48 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.165358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.176540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.177620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.178194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.178670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.183001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.183641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.183915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.184178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.188899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.190337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.195102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.196587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:13.207268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:13.208236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:13.209110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:13.209110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:13.209110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:13.209110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 349/673] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:13.209340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:13.216389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:13.217305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:13.218165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:13.218165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:13.218165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:13.218165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 325/674] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:13.218387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.259486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.324428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaba60-b8c2-4968-b81d-4edff5b9dfed None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.325776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86626be5-6df3-4f8c-885f-ac5b6d331e51 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.359951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.360551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.360837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.361100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.361746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.361867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=29f9cc8a29c4481491d319883cab7056) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.362114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.362884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.363375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.363639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.364038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.365271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.365673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.367189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.375284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 326/675] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/role_assignments?user.id=29f9cc8a29c4481491d319883cab7056&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.375284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.387896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 350/676] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.388976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.425861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.505976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa21f8-7ea8-452e-a6f7-79b0e585700d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.515077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c93d97-104a-409e-b469-0427741e2c78 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.517031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.547997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.548606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.548887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.549158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.549802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.550103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.552301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.559763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.560678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.561210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.561670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.562503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.562993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.564721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.574880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 327/677] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.574880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.586805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 351/678] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.587714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.713303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94a9cd-9130-49ad-a552-aca6ae574f33 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.715146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8552c-daa9-47dd-a3cd-bb10ebf566ec None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.716880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.752374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.753048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.753373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.754287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.756862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.757692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.758169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.758637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.759615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.760124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.761720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.761993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.763162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.775514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 328/679] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.775514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:13.777231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:13.778083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:13.778949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 352/680] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:13.784636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:13.813590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:13.921478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c19e1-daab-46d0-b7ce-a5c8c92e1f55 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.937106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66bec-fb23-4ae1-a3db-0bc5987c1589 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:13.963158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.963816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.964105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.964368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.965058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:13.965358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:13.966807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa311e-63d2-4f2b-ad33-eb381dde55ff None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:13.981025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 353/681] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:13.983089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee39e6-b646-4c8c-85f0-4e4be8f54573 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.983395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee39e6-b646-4c8c-85f0-4e4be8f54573 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.983663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee39e6-b646-4c8c-85f0-4e4be8f54573 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.985002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 354/682] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:13.990462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:13.992627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:13.992627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:13.992627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:13.992887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee39e6-b646-4c8c-85f0-4e4be8f54573 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.007566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.009070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-7eb30700-3b78-4a44-889d-9f7f14eddfaa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:14.024354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:14.025412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:14.026323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 329/683] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:14.026909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.027582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.027582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.047541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:14.050156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:14.060123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.108672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.133690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee39e6-b646-4c8c-85f0-4e4be8f54573 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.150144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 330/684] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:14.151363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.195655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.196674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.196958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.197229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.198223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=21d525a5c45e472e8e5f56d15b43df0b) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:14.198533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.199999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.208587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 355/685] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:13 2022] GET /identity/v3/role_assignments?user.id=21d525a5c45e472e8e5f56d15b43df0b&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:14.215349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.277525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85192e-889f-4367-bfd4-bd2ce3932c20 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.350559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.351194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.354291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.354601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.355408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:14.355717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.357178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.385356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5529b-33f1-4bd4-9cbc-411cacfc5a5b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.406391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 331/686] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:14.412608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.425274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.440546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bef32-0620-4add-8416-4657317367f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.441385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bef32-0620-4add-8416-4657317367f4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.441905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bef32-0620-4add-8416-4657317367f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.443146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bef32-0620-4add-8416-4657317367f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.458933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bef32-0620-4add-8416-4657317367f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.461143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bef32-0620-4add-8416-4657317367f4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.470524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-965bef32-0620-4add-8416-4657317367f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:14.485874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:14.488168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:14.489561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:14.489561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:14.489561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:14.489561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 356/687] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:14.494634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bef32-0620-4add-8416-4657317367f4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.561480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd479c02-8e8e-49c1-8a6c-ca8cae3e1aeb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.610101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.610704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.610978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.611265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.622803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bef32-0620-4add-8416-4657317367f4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.659282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.660458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.660739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.660999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.661637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:14.661931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.664270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.677755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 357/688] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:14.684305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.719013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.721438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.726109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.794692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:14.866739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440eab-d08b-4ae5-8c94-253a80f2b1f9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:14.919022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 332/689] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:25:14.924623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:14.938716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:14.939423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:14.939700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:14.939967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:14.940657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:14.945070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:14.988297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 358/690] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:25:14 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:15.063726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b05b3c-d65f-4d9a-b5ec-f2197c51303d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:15.067139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:15.104276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:15.104925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.105200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.105466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.117741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:15.119201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:15.135879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:15.136839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:15.137704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:15.137704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:15.137704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:15.137704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 333/691] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:15.143651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:15.269560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fb510-558f-4664-af7c-5f091ca42e34 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:15.287977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:15.314448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:15.315055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.315376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.315640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.316898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:15.317190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:15.318550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:15.331368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 359/692] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:15.336827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:15.468060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a72b2-8e8e-451d-80d5-2396790718b4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:15.512829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:15.513463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.513741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.514012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.523276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:15.524744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6b20012c-40d3-4210-95ca-961263234080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:15.536568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:15.537534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:15.538376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 334/693] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:15.559288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:15.766165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0d066-33a1-45f5-ad32-985f850c6eb4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:15.833409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:15.834031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.834306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.834570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.835090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c10da-464a-4e71-803c-624aab3c723c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.835537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:15.835627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:15.836117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c10da-464a-4e71-803c-624aab3c723c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.836584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c10da-464a-4e71-803c-624aab3c723c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.836987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:15.838695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 335/694] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:15.844089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:15.844642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:15.845114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:15.860768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 360/695] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:15.863501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:15.882049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:15.883630 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:15.906847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:15.947459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:16.040513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 336/696] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:16.058724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ec8af-06f8-432f-be0e-7ab76becf831 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.079083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:16.118059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.119494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.119770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.120040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.120765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=f493544ed09444499776046e5e36ec6a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:16.121069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:16.122491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258ecdd-e1ba-4e70-8fa8-515f91af411d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:16.137536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 361/697] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:15 2022] GET /identity/v3/role_assignments?user.id=f493544ed09444499776046e5e36ec6a&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:16.266686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330e47-2c63-4d84-ac27-4cf437de2eb8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.270548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64599-7e7c-4b6b-91e5-4fb9bb2202d9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.270979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64599-7e7c-4b6b-91e5-4fb9bb2202d9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.271339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64599-7e7c-4b6b-91e5-4fb9bb2202d9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.280356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 362/698] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:16.286107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.286389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.286668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.323278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:16.323278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:16.327267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.327267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.327267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.327267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.327627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:16.330817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:16.350786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:16.351883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:16.352741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 337/699] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:16.360894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:16.457643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 363/700] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:16.482529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:16.497795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:16.526313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:16.609072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d49d7-be5a-4b10-8f32-17dda1ff91ad None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.628855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5a7d0-f3da-49eb-b649-d68aeb6d8ed8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.646788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.647425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.647705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.647981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.648712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:16.649077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:16.650532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:16.655682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 338/701] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:16.662074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:16.675742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.676980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.677459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.678149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.693332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:16.700626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:16.701601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:16.702457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:16.707287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 364/702] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:16.708120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:16.755565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:16.790426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2925b9c-9903-47e6-86bb-0573d49715c1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.804054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:16.818687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62260f53-e8ee-47a3-8819-faf4419ae943 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:16.841664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.842321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.842758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.843030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.844587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:16.844862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:16.851162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:16.868041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 339/703] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:16.879289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:16.879919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:16.880197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:16.880465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:16.881137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:16.881436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:16.882804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:16.896223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 365/704] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:16.901508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.034840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b8533-27dd-4b4b-9911-066b16c4c1df None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.085592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:17.086278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.086566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.086839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.094673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:17.102489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:17.104272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:17.123685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:17.124676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:17.126177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:17.126177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:17.126177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:17.126177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 340/705] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:17.130681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.241303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346e027-9fba-452e-aecb-2856087d00cf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.280607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:17.281381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.281749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.282038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.282809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:17.283234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:17.285021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93586413-e7da-4ed8-a257-cf80e2d660c1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:17.298007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 366/706] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:17.306217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.429699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057731-6350-455d-877f-0ea44861643b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.429699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057731-6350-455d-877f-0ea44861643b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.429699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c057731-6350-455d-877f-0ea44861643b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.430566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 367/707] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:17.436863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.437370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.437845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.447468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9773fa7-c232-447c-a562-dc801629493e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.459736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:17.461241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:17.465800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:17.518467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:17.519658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.519943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.520214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.541477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:17.543285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:17.547390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 368/708] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:25:17.565963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:17.566543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:17.567445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:17.568371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 341/709] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:17.573211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.683350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:17.683536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f9243-ab19-486a-9345-e28aa6bab59b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.721990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:17.722653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.722929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.723197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] PATH_INFO: `/v3/services/network` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.723809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:17.725165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-41bc387c-dfb0-4bfe-bf99-33b45b7c0521 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:17.738004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:17.739012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:17.739855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:17.743350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 369/710] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:17.744628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8ba6-1992-415f-8b66-823f516d8277 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.744912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8ba6-1992-415f-8b66-823f516d8277 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.745189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c8ba6-1992-415f-8b66-823f516d8277 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.747378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 370/711] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:17.752680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.752954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.753242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.772051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:17.773198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:17.782887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:17.783132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4635d7-0524-4403-892f-160e48b71edd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.824014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:17.825101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:17.825101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:17.825518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:17.826378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:17.826820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:17.828346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:17.848339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 342/712] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:17.849362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.859679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 371/713] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:25:17.861494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:17.954743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128f114-380d-42c4-b2de-626be2cea223 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:17.965805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:17.999737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.000512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.000942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.001334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.002019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] RBAC: Adding query filter params (name=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:18.002555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.004432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.009536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 343/714] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:18.010035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f2e05-1ed2-4191-8e6e-089c17bb7c3b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.010527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.123756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84e4ab-0064-4099-8388-260b5e4af178 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.162923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.163817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.164259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.164684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.179217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:18.180755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.181456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.181858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.182223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.185056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:18.185339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:18.186307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:18.187459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:18.191995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 344/715] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:18.193118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.230922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.262576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.264083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.306552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fb851-3926-47fb-b858-f6d088a0f19d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.342936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.343566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.343897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.344223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.344855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:18.345152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.346537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.351455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 345/716] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:18.352027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.401837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 372/717] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:18.407963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.464015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.471719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a586b7-ac61-4daa-9a05-59295941b9d1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.478220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.510133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.510700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.510974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.511337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.512004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:18.512301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.513649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.523760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 346/718] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:18.529273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.613905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f59e7-3351-4c2e-a60d-fa1d03296598 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.655105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.655832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.656104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.656365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.668075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.669513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7a015888-e01f-43f5-95c6-e56536249ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:18.684600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:18.685558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:18.686418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:18.686418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:18.686418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:18.686418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 373/719] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:18.691264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017672c-4b38-4f1a-ad1c-b0aa110c1e0d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.691264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017672c-4b38-4f1a-ad1c-b0aa110c1e0d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.691264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017672c-4b38-4f1a-ad1c-b0aa110c1e0d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.693210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 374/720] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:18.694026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc4a8d-cf63-4b13-853a-80c7358cd20a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.694300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.694574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.694835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.713239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:18.714498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:18.734154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.734779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.735050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.735355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.750124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.751864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:18.770766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:18.772641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:18.774472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:18.774472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:18.774472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:18.777099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 347/721] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:18.777099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.797592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 375/722] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 20:25:18.798523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.798809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.835778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:18.902851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51abf0-85eb-40c9-828c-0438f7c7ee44 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.931259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25014a6b-a8c8-4794-9cd0-c049350925bb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:18.951590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.952563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.953564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.954074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.955456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:18.956206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.959048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.968917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:18.969467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:18.969741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:18.970005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:18.970647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:18.970942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:18.973013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:18.981873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 348/723] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:18.983016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:18.986709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 376/724] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:18.987571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.071045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.076337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.099215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5516b-a63a-4d2e-8e0d-1c83b3748a16 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.116355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9f502-a0f6-4159-972f-d7a0b9c8fbab None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.134588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.135651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.136119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.136576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.144643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.146317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.156263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.156887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.157159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.157422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:19.159697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:19.161129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:19.162108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:19.164647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 377/725] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:19.166271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.174382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:19.179936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:19.180856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:19.181677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:19.186453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 349/726] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:19.187634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.279345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870d649-4ff4-400f-b502-b7ee83608dd8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.320439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43a004-d4b6-4d26-aa68-61175962495d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.321218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.322090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.322569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.323029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.326539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.334046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.335834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:19.348625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:19.349810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:19.350731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:19.353283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 378/727] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:19.354609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.360854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.369873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.370480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.370754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.371047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.372085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:19.372391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.373814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.385570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 350/728] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:19.388329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.464579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3307f29-301d-4c61-a82f-e2c835e6d9a6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.491816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd92dd-2f58-4656-a7c8-d91e559d7aa9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.501239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.501842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.502118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.502386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.503045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:19.503371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.504754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed79059-93ee-4cba-9df5-8d1375a57bb4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.512800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 379/729] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:19.514015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c165-3587-4b4c-900e-bfd29d81dc7f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.514323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c165-3587-4b4c-900e-bfd29d81dc7f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.514570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4c165-3587-4b4c-900e-bfd29d81dc7f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.515920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 380/730] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:19.521049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c165-3587-4b4c-900e-bfd29d81dc7f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.532711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.533535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.533814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.534129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.535449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:19.535760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.537164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.557496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 351/731] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:19.558135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.591729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.614586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.639328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4c165-3587-4b4c-900e-bfd29d81dc7f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.671889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dda3b-5722-40ff-a098-f40f38c7ec8e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.674020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.674619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.674891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.675154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.675934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:19.676234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.677641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3466c-ea33-4821-9434-b80537120c49 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.683039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 381/732] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:19.684327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.684604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.684867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.707210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:19.708877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:19.733944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.735234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.735726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.736466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.752981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.754761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:19.776717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:19.777721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:19.778585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:19.778585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:19.778585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:19.785919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 352/733] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:19.785919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.798169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 382/734] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:19.799444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:19.861896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.915954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:19.919302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11320dda-901a-4fa7-a3c2-4a72d5219f4f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.926348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd74d-5c3a-4a7c-b70f-8c827765b012 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:19.962065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.963223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.963620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.964267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.972836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:19.973989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:19.974498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:19.975485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:19.976288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:19.976733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:19.979135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:19.999328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 383/735] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:19.999328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.051462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.053625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.114976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367fd17-65f4-474f-ba91-eb47ce3ec9d6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.129387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.154068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.154671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.154944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.155183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.156182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.157198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.169572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.174353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 353/736] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 20:25:20.175659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.178712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 384/737] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:19 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:20.179702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.304968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fb5c8-fc3f-473d-b596-ce6fc472be68 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.324864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd03bb-a5cc-4f8c-9ee6-93964184dc72 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.352621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.353274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.353548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.353812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.364268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.366432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.371066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.372033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.372536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.373016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:20.379450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:20.380428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:20.381336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 354/738] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:20.386870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.390167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.391958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:20.422729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:20.423788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:20.424648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:20.424648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:20.424648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:20.427170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 385/739] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:20.436432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.470104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.498514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.543482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcf7ec-cee0-43a2-a34a-132f6d2a0937 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.572545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567391f-736f-4dbd-9d68-534aa710b58c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.586588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.587207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.587523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.587831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.588490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:20.588788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.590291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecebdd4-6e99-464d-a416-8a6556f0e1d7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.614493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 355/740] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:20.615859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad850-6aa5-4651-be5e-4e9ae893ce3f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.616076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad850-6aa5-4651-be5e-4e9ae893ce3f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.616306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad850-6aa5-4651-be5e-4e9ae893ce3f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.617767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 356/741] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:20.618269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.618879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.619158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.619462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.620115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:20.620418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.620985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ad850-6aa5-4651-be5e-4e9ae893ce3f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.622072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99cd70-ff48-4b50-8050-0acb92ba1592 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.635541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 386/742] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:20.636770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.637057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.637329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.658468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:20.661678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:20.751887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 387/743] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 20:25:20.754686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:20.767750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ad850-6aa5-4651-be5e-4e9ae893ce3f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.781429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.793778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:20.816193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.816852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.817137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.817406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.894598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953c05-7ee5-4568-b55e-060a9206b150 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:20.899519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.901126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.939520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:20.940162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:20.940437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:20.940706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:20.949694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:20.951558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:20.968243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:20.969410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:20.970400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 388/744] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:20.970931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.021270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 357/745] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 20:25:21.022697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.048627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:21.078015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:21.119977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006c46f-0bf8-4b50-893a-a032305ce246 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.154416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8b69b-8790-4700-95d2-90d4d5864293 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.157580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.158378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.158819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.159236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.160617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.162133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.187067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 389/746] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:20 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:21.187863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.238205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.238828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.239107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.239403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.240109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:21.240411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.241879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.272623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 358/747] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:21.278379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.375108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:21.394648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bc724-3368-4343-a5b0-29241bf36809 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.412087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e39d7-444b-421c-8869-03c2be763557 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.442368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:21.450241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.451107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.452277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.452664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.466600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.467302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.468071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.468495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.468630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.469037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.469903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:21.470357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.472488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.479897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 359/748] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/role_assignments?user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:21.484262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:21.485240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:21.486125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:21.486125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:21.486125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:21.486125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 390/749] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:21.495410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.615763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93285-a9a3-4315-9e9a-e4c62fc79dfd None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.654652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.655632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.656074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.656501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.657317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:21.657771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.659425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.669361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:21.675871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 360/750] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:21.681398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.789060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8bd3e-f7ff-47aa-8308-e006e681321e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:21.835492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:21.836125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.836403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.836681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.848774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:21.850529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ad747d19-76bc-4859-a027-5250aed9a5ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:21.866861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:21.867779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:21.868671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:21.870999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 391/751] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:21.877354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:21.992673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444715f5-5871-4f9a-a09c-469c9907ac56 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:21.993290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444715f5-5871-4f9a-a09c-469c9907ac56 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:21.993756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444715f5-5871-4f9a-a09c-469c9907ac56 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:21.995763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 392/752] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:22.004364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.004883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.005352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.026730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:22.028564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:22.030008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31eb6ac-d429-42d6-922f-04cf74cce891 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:22.077681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:22.079428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.082886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.083404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.084341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:22.084872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:22.086550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:22.105502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 361/753] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:22.111990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:22.122539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:22.183728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 393/754] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:22.210047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:22.233058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:22.314775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57e35e-fe4d-4d1a-9343-29f31b0c851f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:22.368894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:22.369880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.370358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.370836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.371794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=f493544ed09444499776046e5e36ec6a) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:22.372301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:22.373934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:22.375274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59386417-f4ae-467e-8af9-ef34117ea65b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:22.381049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 362/755] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/role_assignments?user.id=f493544ed09444499776046e5e36ec6a&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:22.432732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:22.433418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.433700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.433966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.453200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:22.459561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:22.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:22.461992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 394/756] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:22.469757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:22.604304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68c94d-0625-4b32-bf46-fc6a8ee5ef72 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:22.632631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:22.650480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:22.651121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.651427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.651699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.652385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:22.652687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:22.654097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300c1e1-e0e9-4618-95b0-c9b924fd2f45 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:22.664621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 363/757] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:22.670253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:22.715598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:22.784905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bcc1a-496f-406c-a169-e7456634bbcc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.785307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bcc1a-496f-406c-a169-e7456634bbcc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.785454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bcc1a-496f-406c-a169-e7456634bbcc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.788235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 364/758] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:22.792481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.792767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.793037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.801760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7f53-b065-4bec-9cee-990574e85697 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:22.830863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:22.832215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:22.845195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:22.845821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:22.846093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:22.846358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:22.865103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:22.866479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:22.895998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:22.896986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:22.897842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:22.897842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:22.897842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:22.897842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 395/759] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:22.904163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:22.939546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 365/760] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:22.961639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.056941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.086282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa287e-e26e-4fca-8ca3-88849ddc7f24 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.103280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e146f49-53ee-45fb-96df-21cdf84eb72f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.119701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.147148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.148022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.148388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.148746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.149460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.150900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.157233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.157846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.158125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.158397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.159048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:23.159380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.161334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:23.161906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:23.162861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:23.163917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 366/761] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:23.170730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.190397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 396/762] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:23.202918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.275951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8115be6-0269-4545-ab42-49d37503b6ee None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.310726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.311353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.311629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.311897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.312516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:23.312805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.314155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.323046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 367/763] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:23.326338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.407694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.436155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedc458-c2c6-42e6-a415-e1ac7b999218 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.494244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2852947-9b9e-44dd-98d8-bb88a2b6e182 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.505956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.506812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.507277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.507690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.517857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.520037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:23.541248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:23.542361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:23.543497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:23.548555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 397/764] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:23.553112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.559943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.570639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.571522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.571941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.572353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.573141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:23.573582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.575090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.593750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 368/765] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:23.604249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.719012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87702da-68e6-410a-82fe-4ae92d347437 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.755383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.755984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.756257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.756518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.757234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:23.757531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.758935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd77b2-637f-4afc-bc73-274f0bc58a93 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.764534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e050178-b0bc-41d2-bb3f-423d1af9e434 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.786677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 398/766] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:23.787292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.788850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950ca9-9b52-4405-a61f-25179710e1e6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.789307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950ca9-9b52-4405-a61f-25179710e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.789731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950ca9-9b52-4405-a61f-25179710e1e6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.791526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 399/767] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:23.792966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950ca9-9b52-4405-a61f-25179710e1e6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.810471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.811501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.811782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.812329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.813040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] RBAC: Adding query filter params (interface=public, service_id=2f7d2e4456e74735834cb085b1e56ca8, region_id=RegionOne) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:23.813347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.815163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc4724-34eb-4b37-80bb-53f1f230ce00 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.826046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 369/768] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/endpoints?service_id=2f7d2e4456e74735834cb085b1e56ca8&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:23.828005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.828406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.828687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.853139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:23.855149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:23.862734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:23.911743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950ca9-9b52-4405-a61f-25179710e1e6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:23.939573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 370/769] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:23.940747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:23.956391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:23.957840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:23.958119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:23.958388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:23.971913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:23.973856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:23.991763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:23.992744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:23.993598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:23.993598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:23.993598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:23.996543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 400/770] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:24.001717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.048990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.052244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158a29b-cb3e-45b5-9575-fab9bf683b79 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.087548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.088157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.088438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.088699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.089290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.090639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.096213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 371/771] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.096821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.130186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c3c0d-306f-463d-b990-18f690595f39 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.151481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.182021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.184204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.184700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.185149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] PATH_INFO: `/v3/services/network` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.186413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.188753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b92988fe-2c62-4aef-86b3-1454b5131dfc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:24.201668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:24.202887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:24.203940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:24.207604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 401/772] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:23 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:24.209482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599172f2-4d96-443d-bdd3-4f07cab23fcd None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.209930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599172f2-4d96-443d-bdd3-4f07cab23fcd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.210847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599172f2-4d96-443d-bdd3-4f07cab23fcd None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.213200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 402/773] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:24.214629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599172f2-4d96-443d-bdd3-4f07cab23fcd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.217726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87c706-27b2-4836-8eaf-0b0d3174872d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.261034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.261565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.261845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.262116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.262756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.263055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.264443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556c22-0184-4ffb-8dce-8c41842e18d3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.277083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 372/774] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.279432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.279717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.280357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.304228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:24.306321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:24.326502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.363439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599172f2-4d96-443d-bdd3-4f07cab23fcd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.387386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 373/775] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:24.388604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.409441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.410594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.410873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.411142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.411831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] RBAC: Adding query filter params (name=network) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.412134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.413496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.426158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 403/776] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.427969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.477953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.509144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd2bbb-4563-4d39-99bb-bf9546b9608e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.545350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.546088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.546367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce3e7-7321-42c1-b00c-ec56bab59517 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.546534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.546898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.556469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.558437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:24.573686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:24.574709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:24.575945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:24.579427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 374/777] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:24.583409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.592698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.593629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.594151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.594631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.606773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.607074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:24.612862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:24.614439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:24.615280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:24.622578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 404/778] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:24.623741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.696587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c204-9727-4fbb-92c6-cc6d55ae1c82 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.731317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.731929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.732207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.732481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.733109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] RBAC: Adding query filter params (type=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.733408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.734000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4a2cd-1064-4cd2-8e18-483e40f4cf84 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.734771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.736019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.741226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 375/779] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.742142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.775070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.776128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.776612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.777106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.777996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.778502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.780149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.798146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 405/780] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.798146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.825674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:24.852218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adab2ad-99a7-40e1-b7d7-088e0b119d73 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.887314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.888008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.888290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.888564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.889286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.889593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.890947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9c6e-b11c-4ac3-b9ee-d4401d37abbd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.904313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 376/781] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.904313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea05a-8bc6-402b-8500-2a2164cc1cb8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.904313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea05a-8bc6-402b-8500-2a2164cc1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.904313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ea05a-8bc6-402b-8500-2a2164cc1cb8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.906667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 377/782] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:24.907307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea05a-8bc6-402b-8500-2a2164cc1cb8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.915961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1f1d-e1f4-4bb8-ae98-a44b343a14ce None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:24.951908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:24.952624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:24.952908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:24.953173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:24.953867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] RBAC: Adding query filter params (interface=public, service_id=e6e3defcf53941fd8c0c24dc6de57b76, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:24.954168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:24.955928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:24.968487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 406/783] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/endpoints?service_id=e6e3defcf53941fd8c0c24dc6de57b76&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:24.968487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:24.994264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.016865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ea05a-8bc6-402b-8500-2a2164cc1cb8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.050293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.051109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.051446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.051816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.053828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=54e2221204ff4332ba980b9c5779b05c, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.055382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c4ba9-0527-4c15-8789-bf615a738eac None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.065002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.075285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 378/784] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:24 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:25.075511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c536f-f351-477b-86dd-6248d2e6d81c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.080643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.080643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.080643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.104694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:25.106253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:25.123896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.124724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.125101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.125490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.140804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.142541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:25.159970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:25.160985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:25.161848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:25.161848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:25.161848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:25.168863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 407/785] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:25.170146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.198703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 379/786] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:25.199956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.287940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.317909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a02a-915b-4c49-ae0a-43778b2ed1c4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.325143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08859b-81c0-4b38-a073-f269a2079529 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.353811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.354527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.354889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.355275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.355954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.357417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.363255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 408/787] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:25.364171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.382869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.389076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.392040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.392324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.392603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.393282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:25.393589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.395934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.424623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 380/788] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:25.435116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.549517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d3d51-915f-4f47-8651-279a1f8f04f9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.588548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf514-7ddc-4b6a-9d78-9ea349d54b44 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.641235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.642250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.642728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.643222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.644494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.645128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.645412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.645683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.655196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.656653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.657623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:25.663911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:25.664857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:25.665679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:25.668304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 409/789] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:25.669556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:25.670421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:25.671882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:25.676040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 381/790] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:25.677144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.680358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.681210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.743289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:25.817619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573902f-bb35-412a-8e40-3bea5ce1f319 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.852213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43cd5b-0ae7-4146-91bf-035228d19c3a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:25.895595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.897541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.898665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.899140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.900273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:25.901287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.903224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.908529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:25.909420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:25.910445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:25.914242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:25.915196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:25.915727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:25.917340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:25.925360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 410/791] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:25.930603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:25.965545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 382/792] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:25.970528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.008766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.084418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c4a12-abd1-410b-a584-95e84679b416 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.152060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49443b7-572e-4681-b290-2a4e68f0d30d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.162687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.173914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.174551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.174828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.175096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.195069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.196900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.197332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.197523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.197802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.198071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.210253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.211634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-68e6cdb9-05fe-4bf7-a5b2-dcce82b6b1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:26.216745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:26.217660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:26.218511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:26.218511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:26.218511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:26.221102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 411/793] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:26.222569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6127a5-5fb7-4c38-899b-c90ec21019a1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.222978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6127a5-5fb7-4c38-899b-c90ec21019a1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.223402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6127a5-5fb7-4c38-899b-c90ec21019a1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.228833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 412/794] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:26.228833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6127a5-5fb7-4c38-899b-c90ec21019a1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-af8d83f0-d7c1-4008-a188-9b3cdd98a860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:26.234424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:26.235582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:26.236584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:26.236584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:26.236584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:26.238004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 383/795] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:26.239268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.239668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.240054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.258804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:26.260182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:26.355605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 384/796] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:26.355605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.363997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6127a5-5fb7-4c38-899b-c90ec21019a1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.389073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.413370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.414669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.415124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.415580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.416638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:26.417136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.419404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.435621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 413/797] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:26.436956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.473070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.485441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cda11-c2ee-4155-a2fd-c4c9d6fe48b1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.523446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.524152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.524505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.524877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.525788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:26.526155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.527806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.540216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 385/798] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:26.541084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.560728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de57d-bd72-4efe-872d-3dfeda87865d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.607460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.608183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.608534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.609391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.609484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.610937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:26.621142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:26.622104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 20:25:26.622912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:26.627414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 414/799] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:26.628345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.668119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845b182-5ba0-460d-8425-e33f1c17260b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.677069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.707186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.708164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.708671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.709113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.717281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.719143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:26.731463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:26.732407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:26.733320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:26.736040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 386/800] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:26.736978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.746870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53f781-c237-4045-93bb-d41446550701 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.750663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.786879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.787655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.788236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.788345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.795926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.797461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:26.809341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:26.810242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:26.811088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 415/801] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:26.811728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.854045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc554-f095-40cd-82b0-4dc66fb14053 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.890538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.891444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.891897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.892376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.893166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:26.893660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.895871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.905587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 387/802] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:26.906762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.916578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:26.919565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16ae7-e2b1-4039-9cfe-e678380495dc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:26.957600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:26.958462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:26.958777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:26.959166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:26.960013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:26.960482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:26.961986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:26.985256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 416/803] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:26.986329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:26.992766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.020796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cecc51-fa03-4d18-81db-893243791d30 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.056678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.057597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.058013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.058419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.059279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:27.059716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.061455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.075376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 388/804] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:27.076480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.093788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ba02c-bf33-42a9-a302-7513af110838 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.131116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.131834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.132119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.132392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.133181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:27.133356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.134682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.145825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 417/805] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 20:25:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:27.146814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.178345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.192922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483efdf6-6441-4447-8a36-ce38a5ad576a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.234669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.235327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.235607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.235877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.239143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.249233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.250673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:27.265954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:27.266891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:27.267823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:27.267823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:27.267823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:27.267823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 389/806] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:27.268814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.274194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed5051-4d72-479a-b33d-c0667eab3088 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.314245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.315098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.315209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.315476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/3e6a6c8f45c84ebc9e9cfe1b32836e77/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.332540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=3e6a6c8f45c84ebc9e9cfe1b32836e77, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.333994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8e4ad-f277-476c-93c1-eba1959b9ba3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.346990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 418/807] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:27 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/3e6a6c8f45c84ebc9e9cfe1b32836e77/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:27.348257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abcfd-6293-43cd-bc5f-a04c8e973d87 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.348542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abcfd-6293-43cd-bc5f-a04c8e973d87 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.348817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5abcfd-6293-43cd-bc5f-a04c8e973d87 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.354037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 419/808] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:27.354037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5abcfd-6293-43cd-bc5f-a04c8e973d87 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.389385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35883aa-a03d-4466-908e-f41347a942e9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.432343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.432878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.433157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.433427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.434099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.435535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7327b8-a2d5-4124-a78d-0145c8725be2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.449608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.471743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 390/809] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:27.474312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.474984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.475499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.518564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:27.522013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:27.528138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5abcfd-6293-43cd-bc5f-a04c8e973d87 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.583783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.584614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.585071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.585364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.585547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.587500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:27.587818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.589312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.604605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 420/810] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:27.610401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.633213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 391/811] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:27.659671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.717754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aec4a-de6f-46d6-a3f9-833bd3ffc410 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.748168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.759026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.759897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.760318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.760592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.769023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.771050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.777342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2491201-f957-402f-8d40-51626c5b0b9b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-421ad5b4-aa1a-4d12-a069-cc9bbf3b2dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:27.783371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:27.784245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:27.785595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 421/812] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:27.786093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d11d-46d3-4dfc-803f-92c7bb85e566 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.786284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d11d-46d3-4dfc-803f-92c7bb85e566 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.786604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95d11d-46d3-4dfc-803f-92c7bb85e566 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.787916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 422/813] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:27.792108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d11d-46d3-4dfc-803f-92c7bb85e566 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.819910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.820900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.821385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.821833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.836003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-64271717-fab4-4f80-9caf-7f7bd0e284f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:27.841322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:27.842236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:27.843056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:27.845916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 392/814] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:27.847450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.847895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.848328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.870615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:27.872375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:27.902387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:27.913158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95d11d-46d3-4dfc-803f-92c7bb85e566 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:27.956002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 393/815] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:27.957118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:27.963395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:27.964215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:27.964637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:27.965055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:27.965886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:27.966415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:27.968403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:27.981676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 423/816] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:27.989099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.057146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.081352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f4178-f906-4cb3-a0e9-790fc15ea1d0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.123931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41468-ad94-4596-9dad-fb899c7b9f72 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.132584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.133330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.133720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.134083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.134869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:28.135699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.137591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.150169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 394/817] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:28.151552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.163628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.164332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.164607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.164926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/f493544ed09444499776046e5e36ec6a/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.166896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=f493544ed09444499776046e5e36ec6a, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.168592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.191389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 424/818] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:27 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/f493544ed09444499776046e5e36ec6a/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:28.191389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.191695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.364857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e9b4-379f-44fc-b77f-5c8d43078db5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.405131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c24cb-0cae-4f5a-9380-304b49d39136 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.408825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.409286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.409286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.409495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.410703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.412206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.418615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:28.422491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:28.423584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 20:25:28.424415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:28.427359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 395/819] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:28.430449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.457465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.459097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.459999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.460471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.475746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.477589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:28.498954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:28.500087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:28.501244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:28.501244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:28.501244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:28.502793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 425/820] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:28.509002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.544253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.566235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113885f-4217-40aa-97f6-84ed7381f8c3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.635027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.636015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.636518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.636983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.637810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] RBAC: Adding query filter params (name=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:28.638301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.640109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.647529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 396/821] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:28.653549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.714382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10024cf0-fabe-4c78-9409-6839bd37c82a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.792587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.793214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.793492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.793761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.794406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:28.794709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.796100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.807609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9fd-077c-4186-afc6-f0e109267d2c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:28.818002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 426/822] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:28.828433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.845446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:28.846057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:28.846334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:28.846604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:28.847898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] RBAC: Adding query filter params (type=network) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:28.848208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:28.849561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:28.854911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 397/823] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:28.860819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:28.871752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.895687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:28.998366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf436-3a7a-4aa1-85b7-3d43c36379ef None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.019152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccad975-b7cb-40f3-bbce-c472b5091741 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.034087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:29.035217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.035586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.035866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.036507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:29.037896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:29.066388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 398/824] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:29.091280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:29.092001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.092335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.092654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.108716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:29.110250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:29.130794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:29.131811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:29.132730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:29.133259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 427/825] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:29.140540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:29.264557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:29.315016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f8c9-d05e-49dd-8185-5684056b7894 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.356440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:29.357046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.357322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.357588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.358308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:29.358606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:29.360042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f9654-b331-425f-9c72-7a3ec05b940e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:29.378050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 399/826] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:29.383216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:29.473204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:29.502053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c64019-cebf-45a6-abf2-5158cb7d718f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.542708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:29.543257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.543547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.543818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.639929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:29.641404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:29.712394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299789-1e24-4bef-aaad-fa9e981b8924 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.712896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299789-1e24-4bef-aaad-fa9e981b8924 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.712972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299789-1e24-4bef-aaad-fa9e981b8924 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.714250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 400/827] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:29.720399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147cdc6-0467-49f0-b39f-defa49fc77cf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.720683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147cdc6-0467-49f0-b39f-defa49fc77cf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.720953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147cdc6-0467-49f0-b39f-defa49fc77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.732254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:29.749981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3147cdc6-0467-49f0-b39f-defa49fc77cf None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:29.752256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3147cdc6-0467-49f0-b39f-defa49fc77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:29.759049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 428/828] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:29.766077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:29.845408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 401/829] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:29.868708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd6d3-f75f-4b8e-86fa-78c27e100f65 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.869320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd6d3-f75f-4b8e-86fa-78c27e100f65 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.869610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd6d3-f75f-4b8e-86fa-78c27e100f65 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.871690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 402/830] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:29.872653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bd6d3-f75f-4b8e-86fa-78c27e100f65 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:29.875366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc22c-e549-480b-8531-ec056c61ee3e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.910511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:29.911132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.911438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.911709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.921946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:29.923410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:29.933696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a7f2af3f-c9f1-448f-a9ed-9f7e6d550326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:29.938973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:29.939935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:29.940812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:29.940812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:29.940812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:29.940812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 429/831] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:29.942201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:29.942480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:29.942750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:29.961306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:29.962625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:29.983300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bd6d3-f75f-4b8e-86fa-78c27e100f65 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:29.987160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.022167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.022800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.023079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.023384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.033504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:30.039373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 430/832] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:30.039373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:30.039576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:30.040548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:30.041350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 403/833] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:30.048446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.143015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c81b-6521-4d58-829a-081832699bd0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.157388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d614-88dd-47b8-acce-0c22cefcb933 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.179914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.180768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.180768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.181047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.181335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.181680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.182343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.183755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.194983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 431/834] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:30.195804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.203657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.204909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.205646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.206096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.207861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.208648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.210489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.215968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.220247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 404/835] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:30.220974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.309679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011062d4-4a98-4fa2-9b64-9b7678a20aa6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.325689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473f58-b325-4436-91a7-3ce6787c6233 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.346795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.348064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.348354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.348601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.349178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.350537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:30.359301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:30.360299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:30.361111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 432/836] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:30.361886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.365164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.365805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.367038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.367341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.375508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.376982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:30.389104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:30.390177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:30.391344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:30.395461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 405/837] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:30.396136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.455003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.468254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.487699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56aa2b4-bb2b-4cb8-a288-438ca5183037 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.515094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c248-1bb3-47a6-b258-4799b317c930 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.521468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.522183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.522456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.522720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.533182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.534635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:30.548316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:30.549296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:30.550827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:30.550827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:30.550827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:30.550827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 433/838] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:30.550827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.553337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.553337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.553337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.553337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.553793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.554007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.555369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb16c02-8e6b-48db-869f-b84e934f9c03 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.562836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 406/839] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:30.564027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766e81-be8c-4364-ad36-3a7a30eb7700 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.564309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766e81-be8c-4364-ad36-3a7a30eb7700 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.564581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21766e81-be8c-4364-ad36-3a7a30eb7700 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.565797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 407/840] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:30.566993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766e81-be8c-4364-ad36-3a7a30eb7700 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.660680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18caa-2e05-430a-a4cf-02d842b1e385 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.672737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21766e81-be8c-4364-ad36-3a7a30eb7700 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.680038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.693429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.694029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.694305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.694575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.695270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.695582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.697005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.698560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.708047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.708644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.708924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.709188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.709816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.710123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.710680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 434/841] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:30.711495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.711600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184443f-76fa-41de-89eb-adf2541cbefd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.725646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 408/842] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:30.725646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.725646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.725646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.741616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:30.742789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:30.820471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 409/843] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:30.821304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.823661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f64576-15e5-4fc9-ae78-21b03d737655 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.857216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.857818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.858094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.858363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.858985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.859306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.860657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:30.865447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 435/844] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:30.866204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:30.931785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.941563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:30.948006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a3bc8-26a5-492b-b463-7a7c39bd4b78 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.984247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af786-e5f9-4d2c-99c5-b46debc0fd71 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:30.984492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:30.984930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:30.985204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:30.985471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:30.986328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:30.986631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:30.988649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.003281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 410/845] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:31.003281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.048829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.049474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.049749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.050016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.062997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.066101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:31.088572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:31.089594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:31.091289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 436/846] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:31.096218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.156551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa18fc9-adf8-4c59-8412-0236409ff0aa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.197800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.198820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.199359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.199815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.212600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:31.219351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:31.220282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:31.221112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:31.221735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17191d5-476b-4307-81c9-0832fe14e7da None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.223623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 411/847] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:31.230496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.240491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.259254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.261904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.262514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.262791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.263049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.263802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:31.264103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.265535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.285816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 437/848] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:31.292823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.365579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1232-d59d-41fa-bb49-000bb99feeaa None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.407372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1107a-6589-4f66-ad18-98791bcc5dd2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.409572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.411733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.412187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.412604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.413414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:31.413882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.415417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.428288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 412/849] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:31.433171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.450332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.451006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.451406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.451768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.498695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.524564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.526150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.535644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.556569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb3b7f-7dff-4fbc-8dae-5e6da14ea0e2 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.599666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.600682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.601178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.602298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.614535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.616367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.630377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 438/850] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:31.633564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:31.634726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:31.635670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:31.635670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:31.635670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:31.635835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.637784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 413/851] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:31.643634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.726443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.750329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec522763-b949-403c-b9e0-4f1ea95f62f0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.773922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05417b4c-f309-42e4-8f6f-152ac4d24e89 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.785983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.786728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.787006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.787301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.798247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.799785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.812642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.813505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.813985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.814454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:31.815134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:31.816092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:31.816959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:31.816959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:31.816959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:31.817826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:31.818338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.819923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.820855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 439/852] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:31.821809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.822543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.836186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 414/853] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:31.842962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:31.938311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd4a7-3554-4b86-9d51-c06ea94ca66e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.945035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98596fba-d2ca-406a-92cf-a739326ecdd3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:31.969184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:31.978750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.979428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.979769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.980125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.980831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:31.981195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.982174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:31.982690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:31.983231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:31.983707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:31.984152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:31.992149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:31.993922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.000213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 440/854] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:32.001184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:32.009239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:32.010257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 20:25:32.011194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:32.018376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 415/855] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:32.020091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.083074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.113511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4b62-ffdc-465c-b32d-e32a7fc4be85 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.132027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78c1a7-b762-4e10-9380-f910166b6185 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.149494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.150355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.150771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.151178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.158686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.160997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.167481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.168083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.168359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.168624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.169344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:32.169643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.171043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:32.174730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:32.175831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:32.176842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:32.183162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 441/856] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:32.184166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.189529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 416/857] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:32.195385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.248458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.306177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e23c-187f-4bd5-90a7-c0fe2147f483 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.325805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf00ff-f554-4984-819f-d34b4c450366 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.342065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.342809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.343177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.343528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.343643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.344409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:32.344790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.346575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.363676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 442/858] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:32.365484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.374429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.375031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.375356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.375625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.446967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.448756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.492559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0fff59-7663-44c3-ae4c-7e36718e4ad7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.502227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.531289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.531854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.532125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.532389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.533106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:32.533461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.534865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.547271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 443/859] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/role_assignments?user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:32.562636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 417/860] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:32.568659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.690664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29f869-a65c-4e2b-8eee-68527a430350 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.727389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.728018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.728291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.728555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.740332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.741779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:32.756748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:32.757682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:32.758800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:32.758800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:32.758800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:32.758800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 444/861] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:32.765277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.780184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.875495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fda17-504a-4b4b-aeb8-d89576bd0649 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:32.911001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:32.911872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.912293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.912706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.913536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:32.914000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:32.915524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fd6f-77c0-4d4b-af06-1030d92dd05a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:32.928074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 418/862] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:32.933924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:32.960044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:32.976221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6ff0-e0ea-41f1-a2d3-7f924be71e5f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.976823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6ff0-e0ea-41f1-a2d3-7f924be71e5f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.977290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd6ff0-e0ea-41f1-a2d3-7f924be71e5f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:32.979278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 419/863] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:32.985116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dbe03-153b-4bd2-8f59-b20c3f105d04 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:32.985417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dbe03-153b-4bd2-8f59-b20c3f105d04 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:32.985695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dbe03-153b-4bd2-8f59-b20c3f105d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.008167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1b2dbe03-153b-4bd2-8f59-b20c3f105d04 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:33.010255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1b2dbe03-153b-4bd2-8f59-b20c3f105d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:33.060428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a8c8-25f7-4a59-9d9f-449be3d6ed27 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.086582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 420/864] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:33.105968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.106943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.107651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.107934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.109043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465705dd-c84b-47d3-a13f-234f3127f8a8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.109322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465705dd-c84b-47d3-a13f-234f3127f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.109587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465705dd-c84b-47d3-a13f-234f3127f8a8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.111609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 421/865] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:33.112138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465705dd-c84b-47d3-a13f-234f3127f8a8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.115686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.115821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.118840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-062a72d3-1e21-4b1e-88e6-3727737146c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:33.131690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:33.132600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:33.133465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 445/866] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:33.133945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.134586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.134586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.156580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:33.157768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:33.231292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 446/867] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:33.231489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.247908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.250945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465705dd-c84b-47d3-a13f-234f3127f8a8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.290947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.291498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.291771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.292033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.292712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.294020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.309286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 422/868] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:33 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:33.310385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.347972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81d4f-4a0b-45e3-8554-959b4d5d8ff0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.403385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.407544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.408173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.408440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.408860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.409593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:33.410481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.412153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.428987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 447/869] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:33.439238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.464923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8edc3a-e344-4387-92b7-511a78bfe74d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.522126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.530440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.530440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.530440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.530440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.530814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.532150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:33.543039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:33.544086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:33.544976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 423/870] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 20:25:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:33.550051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.561690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bad9e-53ae-4f45-ba52-1a8fedbbc05c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.600637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.601256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.601528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.601791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.602512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=f493544ed09444499776046e5e36ec6a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:33.602812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.604336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.610721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 448/871] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:33 2022] GET /identity/v3/role_assignments?user.id=f493544ed09444499776046e5e36ec6a&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:33.678635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb7b01-bf23-4e4b-b59a-06b8db6ea740 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.713881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.724322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.724944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.725221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.725491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.726122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:33.726418 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.727979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b09c-1d35-4a98-b6a5-869c3493c4b4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.733767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 424/872] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:33.740447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:33.858223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4361b5-7825-4c20-9b12-60bb0b83d695 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:33.899175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:33.900173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:33.900649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:33.901171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:33.902020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:33.902585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:33.904196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999781c-2c2d-4bde-86b0-3adef2883ce0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:33.905701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:33.915690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 449/873] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:34.734640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127077ee-4f05-49e3-b6b5-584018530fb7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:34.735188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127077ee-4f05-49e3-b6b5-584018530fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:34.735188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127077ee-4f05-49e3-b6b5-584018530fb7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:34.736826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 425/874] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:34.742622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:34.743034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:34.743335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:34.761993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:34.763236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:34.836283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 450/875] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:34.859145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127077ee-4f05-49e3-b6b5-584018530fb7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:34.986027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127077ee-4f05-49e3-b6b5-584018530fb7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.020084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.020707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.020981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.021244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.031710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:35.036876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:35.037789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:35.039016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 426/876] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:25:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:35.046568 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.154852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f863-ffd6-455b-9d1d-ff48996db8db None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.181897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.190433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.191590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.191867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.192134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.192853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:35.193156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.194575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.203373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 451/877] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:35.209348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.263644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.315186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ba877-0909-44df-a452-0dfd80551759 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.350010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.350635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.350907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.351172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.362790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.364237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-023367ee-dcc2-4b5c-a5a5-f666d2c289ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:35.378438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:35.379429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:35.380704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:35.380704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:35.380704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:35.380704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 427/878] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:35.386778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.440180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a2c6-f994-45f2-a743-14c5bf785d25 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.440473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a2c6-f994-45f2-a743-14c5bf785d25 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.440662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a2c6-f994-45f2-a743-14c5bf785d25 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.442252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 428/879] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:35.446981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.447286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.447549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.466289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:35.467675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:35.501842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036d5a-a62d-4df5-abd1-cca41886fdcf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.535542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.536237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.536511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.536773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.537406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:35.537725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.539254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.547522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 429/880] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:35.556499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 452/881] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:35.564297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.569012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.598670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.632249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.679255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ecc9f-0640-4340-bbf5-3c362b287623 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.682784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973f26b-daf4-44b3-b6b2-2711f4b74f09 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.719041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.719605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.719880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.720146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.720819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.721309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.722134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.722258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.722663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.723066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:35.730958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:35.732174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:35.733223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:35.734147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.735800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.737285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 453/882] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:35.738148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:35.749947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:35.751120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:35.752294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:35.759528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 430/883] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:35.760953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.844879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c23d0-9002-4cd0-9fa5-e26f8e4d9aae None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.857603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.859974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:35.867633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc14f67-b24e-4b0f-a99f-478614022c9e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:35.882762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.883401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.883678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.883946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.884567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:35.884871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.886217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641732e3-4357-43c8-bbb5-9e979b876b95 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.890698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 454/884] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:35.891846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7ec7-ebbc-441d-abe6-e3a1838575df None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.892124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7ec7-ebbc-441d-abe6-e3a1838575df None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.892385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7ec7-ebbc-441d-abe6-e3a1838575df None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.893775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 455/885] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:35.898335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e7ec7-ebbc-441d-abe6-e3a1838575df None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:35.912015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:35.912857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.913421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.913868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.914870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:35.915417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:35.917237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b2cdc-6a64-4616-98e6-9440d2cf3de9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:35.941821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 431/886] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:35.943222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:35.943533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:35.943815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:35.961789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:35.962979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:36.001707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e7ec7-ebbc-441d-abe6-e3a1838575df None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.036579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.037182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.037454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.037721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.038341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:36.038632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.039137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 432/887] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:36.040008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.040110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27001b-afb4-48a4-ae2b-1c417212978b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.044745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 456/888] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:36.045851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22311ac6-8211-42d6-bf86-dbfe75efe2ef None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.046128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22311ac6-8211-42d6-bf86-dbfe75efe2ef None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.046394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22311ac6-8211-42d6-bf86-dbfe75efe2ef None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.047694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 457/889] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:36.050422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22311ac6-8211-42d6-bf86-dbfe75efe2ef None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.095068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.127897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.146952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafd5e3-b573-422c-a1ce-41961fb815a8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.152792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22311ac6-8211-42d6-bf86-dbfe75efe2ef None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.180580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.181172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.181441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.181709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.186230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.186825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.187101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.187407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.188097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] RBAC: Adding query filter params (interface=public, service_id=689df70e90804971a5684445348bdc03, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:36.188397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.189749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989affbf-33b6-42a0-afdd-e8d354e72a98 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.194644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 458/890] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/endpoints?service_id=689df70e90804971a5684445348bdc03&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:36.195781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.196060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.196327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.213749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:36.214915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:36.251295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.252773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.280413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 459/891] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:36.281247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.318131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.351320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.370701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 433/892] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:36.371368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.384391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c96e-b773-457e-bd32-f06edf97024c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.418529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.419153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.419453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.419720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.420288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.421644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:36.429926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:36.431056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:36.432408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 460/893] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:36.433384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.470283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efa3f-da2d-4ecd-b69a-2b510005ea20 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.502236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.502899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.503107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.503938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.504528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.505876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.511005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 434/894] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/services => generated 1011 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:25:36.511891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.532739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.536840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f3f3d-c7b3-4c2e-9ccd-2b53bb10637a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.570302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.576916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.577572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.579644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.579921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.580892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.582877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.603028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 461/895] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:36 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:36.604070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.671015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb899-7edc-4ad6-ad08-f13ec0b35f39 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.735524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.736445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.737810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.738826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.749789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003218c-7cf1-4a15-92cb-4ad4fff0b989 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.755547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.757265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:36.780357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:36.781348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:36.782252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:36.782252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:36.782252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:36.782252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 435/896] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:36.790309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.796620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.797236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.797517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.797784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.798411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:36.798760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.800755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.806076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 462/897] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:36.812227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.841532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.919140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:36.929369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a01d-2c87-4e80-b51c-b75bf5ab3a5d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.938397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6f45a-574e-4518-a8bc-b5e024bc3c00 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:36.966890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.967978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.968440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.968904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.970051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:36.970501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.972904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.986805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 436/898] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:36.987648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:36.989049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:36.989459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:36.989884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:36.990645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:36.991074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:36.992602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:36.996491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:36.997955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 463/899] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:37.116225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a03945-7d54-41c9-897e-682488f2d44f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:37.154820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:37.155483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:37.155763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:37.156033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:37.164751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:37.166517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:37.179968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:37.180881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:37.181860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:37.183946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 437/900] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:37.189553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:37.283912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:37.298569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4202e07-d1e8-4b2e-bde2-9a31ccf56e54 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:37.333768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:37.334381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:37.334655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:37.334923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:37.335638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:37.335943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:37.337362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85e45c-8b3c-4fb7-bf0c-35054583d8f6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:37.350596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 464/901] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:37.356586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:37.373137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:37.466626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d9f25-c44a-47bd-a5d0-13f4fbed661b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:37.503420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:37.504373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:37.504887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:37.505360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:37.506277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] RBAC: Adding query filter params (role.id=c29a9cbc89b54a95ba7fb053937d5b5b, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:37.506784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:37.508445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd400a6-1f84-4ea5-81bb-84969b142ed9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:37.514698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 438/902] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:37 2022] GET /identity/v3/role_assignments?user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=c29a9cbc89b54a95ba7fb053937d5b5b => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:38.590891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a144-3a30-464c-a112-3bbfb3b01f81 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:38.591880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a144-3a30-464c-a112-3bbfb3b01f81 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:38.592367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a144-3a30-464c-a112-3bbfb3b01f81 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:38.594170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 465/903] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:38.600237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd19f-08f4-4b9f-b82c-4561b2f9f913 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:38.601267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd19f-08f4-4b9f-b82c-4561b2f9f913 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:38.601748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd19f-08f4-4b9f-b82c-4561b2f9f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:38.622029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0d0fd19f-08f4-4b9f-b82c-4561b2f9f913 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:38.623625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0d0fd19f-08f4-4b9f-b82c-4561b2f9f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:38.701394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 439/904] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:38.708314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf466-6451-43c0-95c3-0e4adc8bbce1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:38.708594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf466-6451-43c0-95c3-0e4adc8bbce1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:38.708863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebf466-6451-43c0-95c3-0e4adc8bbce1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:38.710404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 466/905] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:38.715286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:38.715546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:38.715818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:38.728183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:38.732046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebf466-6451-43c0-95c3-0e4adc8bbce1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:38.735470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:38.737634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:38.829373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 440/906] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:38.846211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebf466-6451-43c0-95c3-0e4adc8bbce1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:38.851729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:38.885682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:38.886649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:38.887118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:38.887601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:38.888386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:38.890235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:38.899455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:38.900426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 20:25:38.901222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:38.903948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 467/907] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:38.910690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:38.928601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:38.966098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329ba01-fc15-4c19-a418-6d8b8b3f4d9e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.002503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.004143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.004660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.005134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.005915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.007516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.010379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:39.018477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:39.019962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:39.020863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:39.021589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa28a1-7ba7-4862-b254-eedffa37c974 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.023745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 441/908] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 20:25:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:39.032820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.067383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.068616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.069506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.070257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.071375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:39.072285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.074144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.086663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 468/909] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:39.089298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.162201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363909-8474-4a12-819f-3febe621ca94 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.181650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.198502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.199110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.199497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.199775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.200403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:39.200706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.202067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e29d5e-86a4-4e05-836c-0322ac29ef2e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.207409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 442/910] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:39.208650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01959f3-a634-4f26-8475-1338a4e4c90b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.208938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01959f3-a634-4f26-8475-1338a4e4c90b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.209036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd84e7-7fd4-423a-bba8-c8da094f99dd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.209203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01959f3-a634-4f26-8475-1338a4e4c90b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.210786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 443/911] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:39.214446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01959f3-a634-4f26-8475-1338a4e4c90b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.246623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.247472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.247888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.248292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.249071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:39.249504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.251198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179e841-aaf3-45bd-8c4b-6354ff365592 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.257159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 469/912] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:39.258577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.258853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.259119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.277215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:39.278498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:39.281748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.330066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01959f3-a634-4f26-8475-1338a4e4c90b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.358103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 470/913] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:39.358103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.376977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.377611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.377889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.378159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.379425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:39.379740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.381126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.386030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 444/914] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:39.386857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.429680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.460757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571df25-3332-4b37-8e8e-4f6429c6ca87 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.496889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206e07e-77b1-4871-948b-046d9319b699 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.499264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.499884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.500162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.500428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.501082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.502436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.523800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.532518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 471/915] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:39.532518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.547282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.547926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.548207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.548480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.549138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.551114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb8ae1-d63c-499e-baf0-798c198d3c4b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.568388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 445/916] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:39 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:39.569587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9bbed-06a4-4ab2-8f92-ce0faa27dfbd None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.569798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9bbed-06a4-4ab2-8f92-ce0faa27dfbd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.570036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9bbed-06a4-4ab2-8f92-ce0faa27dfbd None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.571501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 446/917] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:39.577271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.577642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.577831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.611569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:39.613201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:39.674103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6c74e-70d5-4ae0-b48c-454e3a22df7c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.713389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.722883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 447/918] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:39.727118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.727785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.728457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.728982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.729696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] RBAC: Adding query filter params (interface=public, service_id=b17afb27407947fc8779ae525fac6765, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:39.729996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.732395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.738459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 472/919] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/endpoints?service_id=b17afb27407947fc8779ae525fac6765&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:39.744129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.746968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:39.856484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9f6ff-a771-477e-bb47-f2464207e257 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.867702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69da32-a3be-45b0-b253-75185c6154d7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:39.879392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:39.900695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.901331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.901607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.901872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.910145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:39.910875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:39.911156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:39.911452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:39.912351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:39.913512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:39.916102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:39.920129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 448/920] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:39.922193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:39.923148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:39.924017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 473/921] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:39.931006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.053441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6daeb-2bdf-4ff1-8064-01435b70c2cb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.095046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.096510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.096510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.097660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.097660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:40.097977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.099427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.108649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 449/922] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:25:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:40.114888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.169351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:40.228442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb46f-e770-4781-a468-bcd6df907794 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.264423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.265338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.265758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.266228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.278180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.279832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:40.294495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:40.295719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:40.296871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:40.296871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:40.296871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:40.298628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 474/923] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:40.304151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.341972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:40.410222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1158a4e-1eef-41c0-8cd5-13d9b64925de None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.444497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.445237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.445630 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.445999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.446724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:40.447116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.448567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.461255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 450/924] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:40.466713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.571451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317d599-4ba2-46a7-92dc-3b51643f092d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.573219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:40.606941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.607602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.607876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.608140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.616644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.618078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:40.629696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:40.630592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:40.631559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 475/925] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:40.638333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.735327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:40.742254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c0b1a-73d3-40c9-bc01-dc403465e349 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.778640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.779258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.779540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.779804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.780517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:40.780812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.782218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.799683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 451/926] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:40.805721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:40.907974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17567798-439f-4f48-92fe-215719a4d7f4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:40.942187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:40.942806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:40.943080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:40.943376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:40.953921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:40.955369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:40.969602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:40.970538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:40.971473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:40.971473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:40.971473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:40.971473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 476/927] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:40.976864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.076526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a17e8-f894-4237-a630-6226b05cb393 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:41.111675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:41.112289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.112562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.112898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.113550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:41.113909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:41.115330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:41.128228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 452/928] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:41.136362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.155613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:41.239454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0a5a9-1400-40ca-b8d4-96c890ca24d8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:41.272872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:41.273495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.273768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.274030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.280891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:41.282315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:41.294112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:41.294993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:41.296213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 477/929] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:41.301924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.319977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:41.405246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385bfaa-ad52-4d60-b160-90e670c928f1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:41.439186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:41.439822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.440096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.440362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.441174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:41.441474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:41.442952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45679288-4875-475b-97f8-4e76212fda53 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:41.455602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 453/930] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:41.462419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.538084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:41.563200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36a69f-ae5f-4f72-aa56-feb09db3320b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:41.597971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:41.598624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.598897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.599219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/3e6a6c8f45c84ebc9e9cfe1b32836e77/roles/c29a9cbc89b54a95ba7fb053937d5b5b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.602079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=3e6a6c8f45c84ebc9e9cfe1b32836e77, role_id=c29a9cbc89b54a95ba7fb053937d5b5b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:41.603529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686b99-a70e-4db7-900a-a1ef69b45f1c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:41.619850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 478/931] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:25:41 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/3e6a6c8f45c84ebc9e9cfe1b32836e77/roles/c29a9cbc89b54a95ba7fb053937d5b5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:25:41.731068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6de58-44ca-4a0e-92b2-7ddbdcd6c4e7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.731609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6de58-44ca-4a0e-92b2-7ddbdcd6c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.731722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6de58-44ca-4a0e-92b2-7ddbdcd6c4e7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.733363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 454/932] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:41.739635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.739927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.740184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.759639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:41.760842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:41.824264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70866-fd75-4f65-a710-21d1860829dc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.824707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70866-fd75-4f65-a710-21d1860829dc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.825077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70866-fd75-4f65-a710-21d1860829dc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.826524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 455/933] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:41.832063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:41.832342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:41.832608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:41.847570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 479/934] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:41.852170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:41.853364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:41.867603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.936166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 456/935] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:41.943589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:41.961992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:41.965855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.001028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb1767-80ef-4aef-8e4e-f394e17f9345 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.038022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.038630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.038905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.039173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.039832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.041382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.043841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING keystone.server.flask.common [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 20:25:42.061488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.sql.core [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:25:42.061488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:25:42.061488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [parameters: {'id': '371d6b0d97e841568ba193b268e8d675', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:25:42.061488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80188) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c2ad8620-3a59-415d-87bc-1a197f42ff46 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 371d6b0d97e841568ba193b268e8d675.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 371d6b0d97e841568ba193b268e8d675. Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:25:42.081937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 20:25:42.082766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application yield resource Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise self.value Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application session.commit() Aug 06 20:25:42.083749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:25:42.084650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:25:42.085553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:25:42.086348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [parameters: {'id': '371d6b0d97e841568ba193b268e8d675', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.087182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:42.092103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 371d6b0d97e841568ba193b268e8d675. Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 480/936] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Aug 6 20:25:41 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df96c9-33fa-44bf-bed4-f85cc01f4ca8 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.093526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df96c9-33fa-44bf-bed4-f85cc01f4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.094270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df96c9-33fa-44bf-bed4-f85cc01f4ca8 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.094270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 481/937] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:42.094270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df96c9-33fa-44bf-bed4-f85cc01f4ca8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.098559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed282-d4c6-4f48-b9fe-77fcaf3f55df None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.135016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.135675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.135948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.136213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.136789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.138129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-9ac975ee-9b7b-4cc2-8435-50ca260966d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:42.146889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:42.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:42.148945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 457/938] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:42.149774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.149774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.149896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.168162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:42.169325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:42.208209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df96c9-33fa-44bf-bed4-f85cc01f4ca8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.229525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.240266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.245906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.246417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.246739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.247009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.247722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 458/939] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:42.248588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.266699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.269358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:42.284590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:42.285474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:42.286358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.288047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 482/940] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:42.288995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.364157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1213-3e0e-4c6a-a5d1-3844049c5c7c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.401983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.402647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.402925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.403029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84045-b6a8-411e-8a74-e36d3dfe7828 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.403190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.403850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.404148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.406486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.412589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 459/941] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:42.413380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.445072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.445705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.445985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.446258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.446834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.448226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:42.458136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:42.459045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:42.459974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 483/942] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:42.460772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.479967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.513169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.525972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e278461-ede6-4ad5-8b57-c5c935520e61 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.563644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.564309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.564585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.564852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.565518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.566308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.567753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.573044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c1da-0d15-47da-8e32-3b7896c587f6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.591534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 460/943] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:42.591534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.618667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.619401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.619782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.620155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.621310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.621310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.622822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.634032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 484/944] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:42.635336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.745745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce599-3a61-4436-9e98-19768f7eeae5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.758617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc83ee-f43d-41c6-b36d-5d4424e9f166 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.772685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.780025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:42.798900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.799422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.800431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.800431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.800798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.801174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.802621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.808895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 461/945] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:42.809440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.810048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.810325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.810592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.812099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] RBAC: Adding query filter params (interface=public, service_id=1a717d69823d4960808f1c169e6f1b56, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.812099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.812961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.814683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.824525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 485/946] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/endpoints?service_id=1a717d69823d4960808f1c169e6f1b56&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:42.826374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:42.933501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461d3af-5f8c-466a-a415-9c5762a34335 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.940305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94181fbf-1ccf-4388-a3eb-07aa306b49d8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:42.969205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.969825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.970102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.970424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.971029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.972975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.979682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 486/947] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:25:42.982973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:42.983611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:42.983884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:42.984148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:42.984782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:42.985081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:42.986463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168256f-4b17-491d-bf73-28fe344e3b6f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:42.993803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 462/948] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:42.998581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:43.043666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:43.116391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c09537-db19-4c18-9bc6-d17f19de3be2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:43.155751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:43.156365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:43.156626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:43.156898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:43.157553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:43.158905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3382b66-fb24-4c0a-b495-bc5ba7592faa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:43.181670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 487/949] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:43.683679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971f01-29c6-406d-b6a8-52befecb2fa3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:43.684334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971f01-29c6-406d-b6a8-52befecb2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:43.684830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971f01-29c6-406d-b6a8-52befecb2fa3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:43.686652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 463/950] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:43.692591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:43.692877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:43.693147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:43.711788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:43.713316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:43.787318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 488/951] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:43.812154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7971f01-29c6-406d-b6a8-52befecb2fa3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:43.867955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:43.921750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7971f01-29c6-406d-b6a8-52befecb2fa3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:43.957991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:43.958611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:43.958884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:43.959145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:43.969569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:43.974798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:43.975710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:43.976696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 464/952] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:25:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:43.988445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.007666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:44.092979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22e1eb-4138-4dff-beb3-6b13d936c605 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:44.126558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:44.127090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.127389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.127653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.128822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:44.129125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:44.130473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:44.138766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 489/953] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:25:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:44.144992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.255159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd953c-576d-418b-bc97-e2e3bbe8a771 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:44.266078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:44.295207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:44.296233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.296715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.297200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.308689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:44.310429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:44.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:44.326559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:44.327519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:44.327519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:44.327519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:44.334745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 465/954] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:44.336326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.437277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:44.457352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bd24a-b06a-4857-b686-f7694e5798c4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:44.491487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:44.492086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.492358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.492621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.493247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:44.493541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:44.494882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:44.507145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 490/955] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:44.512834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.618683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6511d9e-ace3-49a8-97ad-8386a5cdbabe None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:44.659496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:44.660492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.660825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.661102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.672227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:44.673690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-239c62b9-dc6a-4075-a20c-5ec36bf43b19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:44.685423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:44.686340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 20:25:44.687326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:44.691389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 466/956] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:25:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:44.693192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.789604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdd0d-eb12-4ebb-83ec-37a90b9f266a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.789929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdd0d-eb12-4ebb-83ec-37a90b9f266a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.790153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abdd0d-eb12-4ebb-83ec-37a90b9f266a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.791772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 467/957] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:44.796991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.797335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.797547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.801342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9af2-23e7-43d9-8568-60c431a26077 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:44.821593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:44.822797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:44.839143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:44.840044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:44.840514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:44.840981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:44.841890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:44.842420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:44.844055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:44.850495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:44.854542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:44.864874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 491/958] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 20:25:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:44.875358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.915328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 468/959] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:44.939811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:44.998214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5b859-ebee-40d1-a847-697ef9213e86 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.034674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.035307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.035585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.035923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.055429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ccc43-c3a3-426b-a65c-bd85780a75ad None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.094432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.095509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.095968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.096463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.097314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.099186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.101980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING keystone.server.flask.common [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 20:25:45.102602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.106673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.108206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c428-e55c-47d1-8a98-0c716ff9bd4b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.118733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.sql.core [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:25:45.118733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:25:45.118733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [parameters: {'user_id': 'd391973e26b2454b8a616c06ba2138f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:25:45.118733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80187) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-60cecc01-f39d-448d-b592-8cbf6a8f1d9c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result.read() Aug 06 20:25:45.126429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:25:45.127491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application yield resource Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application next(self.gen) Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise self.value Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application session.commit() Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 20:25:45.129208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.session.flush() Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application compat.raise_( Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 20:25:45.130089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 20:25:45.130972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application conn.query(q) Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application result.read() Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 20:25:45.131852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd391973e26b2454b8a616c06ba2138f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:45.132678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 06 20:25:45.139513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 469/960] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 20:25:44 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6e9e-a92a-455c-a44f-a8a4c0414c4e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6e9e-a92a-455c-a44f-a8a4c0414c4e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.141664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf6e9e-a92a-455c-a44f-a8a4c0414c4e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.143645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 470/961] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:45.149015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf6e9e-a92a-455c-a44f-a8a4c0414c4e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.166970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.227381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 492/962] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:45.227381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.227381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.227381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.244348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:45.245512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:45.269977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf6e9e-a92a-455c-a44f-a8a4c0414c4e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.308983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.309609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.309891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.310157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.318100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.318534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 493/963] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:45.319511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.319698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-96ceea41-31a6-4559-9023-0751d96c81cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:45.331595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:45.332617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 471/964] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:45.333940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1990-00fa-47db-8b06-3bd6f0c2caa2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.334665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1990-00fa-47db-8b06-3bd6f0c2caa2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.334665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1990-00fa-47db-8b06-3bd6f0c2caa2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.336077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 472/965] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:45.338128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1990-00fa-47db-8b06-3bd6f0c2caa2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.356996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.421899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.429587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc4b5d-c61b-46aa-80c0-4e703aae2258 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.448353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1990-00fa-47db-8b06-3bd6f0c2caa2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.465345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.465964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.466264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.466526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.476932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.478415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.483917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.484504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.484781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.485048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.485728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:45.486024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.487437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d11b382c-eb40-4695-9d1b-3a120f01d022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:45.492957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:45.493908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:45.494797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:45.494797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:45.494797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:45.494797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 494/966] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:45.495383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.495487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.495679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.512617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:45.513786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:45.521492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 473/967] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:45.522306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.597787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 495/968] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:45.597787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.610709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.653434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d077234-4522-445f-ba85-93b8a987002e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.685746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.692428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.693066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.693345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.693608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.694197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.695593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:45.704668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:45.705719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.707175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 474/969] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:45.708160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.717077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799764bb-cefd-40f4-a8ec-0d8fc3f98705 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.760158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.761629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.761629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.761629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.762212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:45.762514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.764266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.776190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 496/970] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:45.777003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.816995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f34d7a-2a32-4644-a282-92cdcb0e8344 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.845769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.852823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.853443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.853720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.853995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.854564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.855957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:45.864916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:45.865914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:45.866714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 475/971] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:45.867537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.877765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15609e81-a995-41b8-978c-db6b6015e399 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:45.910688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:45.911317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:45.911594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:45.911861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:45.912485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:45.912783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:45.914135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:45.918824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 497/972] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:45.919452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:45.930081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:45.972985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c59eec-f163-4863-b601-f8ee4ad3efaf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.005750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.006371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.006646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.006938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.013545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.014910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:46.026387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:46.027511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 476/973] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:46.033347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:46.036997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba185172-ddbb-4f05-9902-2d017ea3cc77 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.070125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.070727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.071007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.071298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.071922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:46.072223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.073578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.074747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:46.083406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 498/974] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:46.084437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:46.126155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b819c2-ace2-474b-a58c-d6a2c6427ac7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.146580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:46.161949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.162546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.162824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.163097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.163759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:46.164057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.165444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.170139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 477/975] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:46.170905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:46.182165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9a6f5-8ba5-4b85-b155-29af3bca2a71 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.218430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.219034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.219344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.219619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.220299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:46.220599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.222094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.233820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 499/976] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:46.234658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:46.269827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab21e5f-373d-4a6a-b78a-96047abacd20 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.295449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:46.307717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.308328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.308609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.308909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.309539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:46.309843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.311212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.315694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 478/977] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:46.316969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:46.348562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba7bea-5041-42f1-ab75-b6d42b694027 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.372535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:46.393623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.394843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.395119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.395415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.396089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.397479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f139cb1-e36f-4046-9cee-04bb51834a21 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.421192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 500/978] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:46.448791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c2ec0-1c2c-4b7c-bcc5-b41e872bba6f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:46.497864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:46.499305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:46.499305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:46.499305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:46.499812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] RBAC: Adding query filter params (role.id=c29a9cbc89b54a95ba7fb053937d5b5b, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:46.500121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:46.501616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55143bf0-d1f2-491d-9727-36bd172acf95 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:46.509619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 479/979] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:46 2022] GET /identity/v3/role_assignments?user.id=3e6a6c8f45c84ebc9e9cfe1b32836e77&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=c29a9cbc89b54a95ba7fb053937d5b5b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:48.348361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa86-87d2-4ccd-ac25-2a5b0367de60 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.348915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa86-87d2-4ccd-ac25-2a5b0367de60 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.348915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2aa86-87d2-4ccd-ac25-2a5b0367de60 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.350375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 501/980] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:48.355465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef813ab-ce81-464a-96fa-df148c7b375c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.355863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef813ab-ce81-464a-96fa-df148c7b375c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.356039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef813ab-ce81-464a-96fa-df148c7b375c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.374549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bef813ab-ce81-464a-96fa-df148c7b375c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:48.376095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bef813ab-ce81-464a-96fa-df148c7b375c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:48.443639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 480/981] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:48.446762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157d3-f45f-4201-8142-9654a77b96de None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.447054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157d3-f45f-4201-8142-9654a77b96de None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.447366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886157d3-f45f-4201-8142-9654a77b96de None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.448788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 502/982] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:48.453644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.453934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.454207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.467429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886157d3-f45f-4201-8142-9654a77b96de None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:48.474918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:48.476277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:48.508216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:48.549962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 481/983] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:48.571930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:48.584104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886157d3-f45f-4201-8142-9654a77b96de None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:48.601336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:48.622340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:48.622945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.623221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.623536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.624180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:48.625537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee47451-5dee-42ce-bf79-78152b9ca4d6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:48.639892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 503/984] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:48 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:48.641341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b3e7-fcee-4bae-8c74-d625496c8600 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.641620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b3e7-fcee-4bae-8c74-d625496c8600 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.641889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b3e7-fcee-4bae-8c74-d625496c8600 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.643083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 504/985] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:48.649069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.649069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.649383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.669038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:48.670449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:48.687948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d6a55-6411-4863-824f-28f3567a0fd6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:48.734007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:48.734652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.734931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.735199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.735909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:48.737212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:48.745574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 505/986] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:48.747268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:48.748289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.749117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 482/987] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:48.757492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:48.767891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:48.799850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:48.875797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e23e-b968-4fd0-99dc-57d236354dba None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:48.878607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44a447-8aea-40f7-ad23-6381efcc58ef None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:48.881336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:48.913046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:48.913674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.913953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.914223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.914806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:48.916201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:48.921433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:48.922244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:48.922770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:48.923231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:48.924066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:48.924547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:48.924838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:48.925856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:48.926708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 483/988] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 20:25:48 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:48.927530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:48.931701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:48.935643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 506/989] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:48.937726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:49.034182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:49.046386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425cd9-61a4-4add-b497-963540fb2ac1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:49.054896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0c40-71f5-41a0-959b-53a6fdbc426b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:49.082016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:49.082609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:49.082882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:49.083148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:49.083800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] RBAC: Adding query filter params (name=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:49.084096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:49.085435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:49.090455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 484/990] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:49.095690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:49.096775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:49.097980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:49.098250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:49.098508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:49.099127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:49.099451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:49.100801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:49.110469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 507/991] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:49.111460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:49.145026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:49.205781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1be366-060e-472f-bdd4-65fd0230fb04 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:49.220378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6f68e-3e71-4d4e-8c70-05d241c753e2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:49.242406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:49.243012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:49.243444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:49.243719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:49.244463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] RBAC: Adding query filter params (type=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:49.244765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:49.246233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:49.259409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 485/992] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:49.262634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:49.263300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:49.263584 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:49.263851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:49.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] RBAC: Adding query filter params (interface=admin, service_id=1a717d69823d4960808f1c169e6f1b56, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:49.264881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:49.266301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5c5a2-8fa7-4560-b713-8fc50e8e7155 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:49.275292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 508/993] 10.222.0.17 () {56 vars in 1249 bytes} [Sat Aug 6 20:25:49 2022] GET /identity/v3/endpoints?service_id=1a717d69823d4960808f1c169e6f1b56&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:49.278326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:49.303831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:49.393466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1bce-4b4d-45fd-816b-89191f9dba21 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:49.429883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:49.430403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:49.430683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:49.430951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:49.431568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:49.432911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1a7b0-73f4-4e50-bbc6-75a32fcb7206 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:49.439090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 486/994] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:49 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:25:50.671744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7f7f4-68be-480d-be4d-d3e2b73bb3c6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:50.672241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7f7f4-68be-480d-be4d-d3e2b73bb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:50.672315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7f7f4-68be-480d-be4d-d3e2b73bb3c6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:50.673745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 509/995] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:50.678800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:50.679170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:50.679380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:50.697935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:50.699103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:50.767309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 487/996] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:50.789513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7f7f4-68be-480d-be4d-d3e2b73bb3c6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:50.887164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:50.895903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7f7f4-68be-480d-be4d-d3e2b73bb3c6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:50.929322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:50.929952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:50.930228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:50.930497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:50.931074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:50.932520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:50.941945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:50.942926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:50.944211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:50.948027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 510/997] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:50.949437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:50.965959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:51.052307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e6a89-2841-4eeb-ad8e-508fe547cf9c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.086041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.086644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.086919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.087184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.087829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:51.088127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.089475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dbde7-7712-4740-9769-8751ae6f2a61 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.098845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 488/998] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:51.100420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.200942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6952cf-952f-4a69-a15c-359eef4883d6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.234036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.234694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.234974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.235258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.235914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:51.236218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.238115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.240424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a0ef-210e-4034-9296-75fc7d681d5e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.240707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a0ef-210e-4034-9296-75fc7d681d5e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.240978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2a0ef-210e-4034-9296-75fc7d681d5e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.242463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 489/999] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:51.247841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 511/1000] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:51.247987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.247987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.247987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.249825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.265445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:51.266611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:51.276718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:51.334410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 490/1001] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:51.356049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.365364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b224-21d1-4f7b-8f3a-5ad4c291c101 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.366952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:51.403585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.404189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.404466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.404737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.405434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] RBAC: Adding query filter params (interface=public, service_id=9e5c2f62af0e4918b4e39fcd733110fc, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:51.405737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.407109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.412917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 512/1002] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/endpoints?service_id=9e5c2f62af0e4918b4e39fcd733110fc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:51.418207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.459430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2491a-5669-4a14-a4ec-11ab3eec4d86 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.493236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.494147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.494431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.494696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.495369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.496714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80908633-5b4c-479e-87ed-8b7ca5c1e385 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.506510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:51.511447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 491/1003] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:51 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:51.512695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bda1-ce1a-4937-8bfb-cbcc7646fcba None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.512976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bda1-ce1a-4937-8bfb-cbcc7646fcba None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.513244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bda1-ce1a-4937-8bfb-cbcc7646fcba None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.515301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 492/1004] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:51.519906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9223d-4b73-48fc-b358-3caba35a381a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.529009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.529338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.529549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.549359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:51.551271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:51.567997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.568680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.568952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.569217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.570033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.571689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.582345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 513/1005] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:25:51.627849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:51.636110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 493/1006] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:51 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:51.660369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.771319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9aa7d-5959-426a-8b00-9e3dab71a7ec None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.808083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.808707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.808978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.809242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.809812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.811161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:51.821162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:51.822139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:51.822955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 514/1007] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:51.829816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.930575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69032809-8f55-42cd-a97a-0740b3921d7b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:51.966050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:51.966973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:51.967452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:51.967912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:51.968717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:51.969183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:51.970734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:51.980362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 494/1008] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:51.981537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:51.997818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:52.086442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583805-c330-45d2-8f6c-16b860370408 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:52.120390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:52.120992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:52.121266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:52.121530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:52.122142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:52.122438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:52.123822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7be6f-0acd-4bb4-ada7-b1c08a5c0e91 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:52.133595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 515/1009] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 20:25:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:52.134552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:52.195108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:52.234395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c69f8-1ccf-4314-b250-92171c2a1cad None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:52.268012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:52.268697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:52.269065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:52.269393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:52.270098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:52.271533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f31ef-f7f9-459b-96a2-2be596a80183 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:52.295289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 495/1010] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:53.557034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca678e5-c2c5-4313-a8b4-837382732de6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.558016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca678e5-c2c5-4313-a8b4-837382732de6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.558533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca678e5-c2c5-4313-a8b4-837382732de6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.560375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 516/1011] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:53.565230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabb1c-5970-4d99-9bfc-79992f778551 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.565636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabb1c-5970-4d99-9bfc-79992f778551 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.565799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dabb1c-5970-4d99-9bfc-79992f778551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.584500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-26dabb1c-5970-4d99-9bfc-79992f778551 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:53.585681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-26dabb1c-5970-4d99-9bfc-79992f778551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:53.665003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e03a-d007-4e57-bfd4-39d550e3df40 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.665346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e03a-d007-4e57-bfd4-39d550e3df40 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.665550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e03a-d007-4e57-bfd4-39d550e3df40 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.666436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 496/1012] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:53.666979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 517/1013] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:53.671792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.672082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.672356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.689433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:53.690448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426e03a-d007-4e57-bfd4-39d550e3df40 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:53.690625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:53.742441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:53.772097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 497/1014] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:53.784222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:53.794291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:53.809851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426e03a-d007-4e57-bfd4-39d550e3df40 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:53.847959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:53.849104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.849383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.849694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] PATH_INFO: `/v3/services/image` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.850272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:53.851835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:53.861770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:53.863387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:53.864232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 518/1015] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 20:25:53 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:53.869695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:53.913573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39710a9-f356-4bf5-956e-137133200a64 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:53.949854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:53.950512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:53.950760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:53.951029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:53.951638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:53.952996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:53.961926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:53.962913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:53.963802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 498/1016] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:53.969173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:53.976286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bed9d4-4cdc-4084-af70-11f292230357 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.012417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.013397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.013905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.014297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.014931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:54.015233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.016625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.017859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.026714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 519/1017] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:54.027836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.031185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.086196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2170b7-aea5-4a3c-a305-f0b0a5192576 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.122742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.123406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.123686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.123956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.124572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:54.124871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.126218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.131035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 499/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:54.136577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.139785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d228c5-90c0-466c-8aeb-7be6bee3d4c7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.177917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.178527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.178805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.179073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.179846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] RBAC: Adding query filter params (type=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:54.180147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.181508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.191668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 520/1019] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:54.192721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.240645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c46c33-e26e-4b06-9589-706b64cfd434 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.247783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.263463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.276934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.277541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.277815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.278090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.278717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:54.279013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.280405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.287200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 500/1020] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 20:25:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:54.292582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.305288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55aa1d-2aa8-4b37-a9af-7966a62ddafe None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.339899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.340429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.340706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.340975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.341664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] RBAC: Adding query filter params (interface=public, service_id=c29cd17f202645f084364585095f9987, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:54.341968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.343353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56f12-23ca-407a-ae17-bcd3e32942ef None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.348233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 521/1021] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:25:54 2022] GET /identity/v3/endpoints?service_id=c29cd17f202645f084364585095f9987&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:54.349405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6fd8-04c4-41b5-b57f-18ed9792199b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.349687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6fd8-04c4-41b5-b57f-18ed9792199b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.349962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a6fd8-04c4-41b5-b57f-18ed9792199b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.351135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 522/1022] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:54.353674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6fd8-04c4-41b5-b57f-18ed9792199b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.394397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65eae-d6e2-4e1b-a16c-ac3ec8724063 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.426910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.427543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.427869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.428139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.428781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.430124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca00e9-29c7-4c85-ab8a-66941e58bf85 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.450060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 501/1023] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:54.451230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.451556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.451827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.469686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a6fd8-04c4-41b5-b57f-18ed9792199b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.472164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:54.473416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:54.500347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.510749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.511574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.511709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:54.511907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.512119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.512746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.514252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.529769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 523/1024] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:25:54 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:25:54.563880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 502/1025] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:54.588959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.702453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a3d10-f1ca-4c78-a5b2-2727988a313f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.739543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.740166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.740443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.740708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.741790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.743204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c69db-94b4-4192-8f84-322ab76a5547 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.744938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 524/1026] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:54.750548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:54.852269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9832f1-0970-423d-8a5d-a66b118de2ae None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:54.886356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:54.886954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:54.887228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:54.887520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:54.888149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:54.889565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec842f1-eab3-4bdd-bf9a-1047fb017197 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:54.916492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 503/1027] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:25:54 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:56.541408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116da42-96e4-45e4-8353-f3e35526bf11 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.541932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116da42-96e4-45e4-8353-f3e35526bf11 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.541932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116da42-96e4-45e4-8353-f3e35526bf11 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.543474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 525/1028] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:56.548499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.548879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.549042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.567627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:56.568819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:56.570984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:56.588758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f56e9-6bb6-4e84-b3ba-96c90c088a99 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.589040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f56e9-6bb6-4e84-b3ba-96c90c088a99 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.589315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f56e9-6bb6-4e84-b3ba-96c90c088a99 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.590773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 526/1029] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:56.596169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.596564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.596965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.615446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:56.616710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:56.648147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 504/1030] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:56.670584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:56.676953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:56.689600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 527/1031] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:25:56.713967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:56.778094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6a99b-a98c-46bf-b0a8-dd283801d7e1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:56.814259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:56.814793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.815072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.815277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6e0b7-5566-4b14-86b9-e2dfe6cc814c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:56.815398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.816458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:56.817822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:56.827338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:56.828403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:56.829253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 505/1032] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 20:25:56 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:56.836011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:56.840032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:56.866435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:56.867156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.867468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.867745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.878137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:56.883368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:56.884318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:56.885166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 528/1033] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:25:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:56.890650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:56.945988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:56.951525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00707211-43ac-4f65-8989-45413c89abe9 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:56.987064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:56.987866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.988141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.988409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.989031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] RBAC: Adding query filter params (name=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:56.989327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:56.990674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fbc25-4304-4170-9288-301587b1f89d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:56.995374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 506/1034] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:56.996514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a56a8-a753-42c3-97a3-3c0f8d5fa76a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:56.996798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a56a8-a753-42c3-97a3-3c0f8d5fa76a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:56.997070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a56a8-a753-42c3-97a3-3c0f8d5fa76a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:56.997812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef1f4a-a960-46a6-a967-e821628d7f7d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:56.998414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 507/1035] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:57.002945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a56a8-a753-42c3-97a3-3c0f8d5fa76a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.032761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.033370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.033648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.033926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.034606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:57.034911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.036300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebddfd-9024-4030-8c7e-ad73d6e5703a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.044054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 529/1036] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:25:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:57.045184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.045468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.045740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.063498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:57.064738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:57.069843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.105701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a56a8-a753-42c3-97a3-3c0f8d5fa76a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.130371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 530/1037] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:57.131183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.138883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.139514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.139797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.140069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.141065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] RBAC: Adding query filter params (type=image) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:57.141368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.143060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.152903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 508/1038] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:57.153861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.178388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.233277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcd5d0-0bbe-4b57-bfc2-7326af640a34 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.251143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b880e-1cb6-420f-aa9d-fe6548c3af98 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.266491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.267109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.267431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.267694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.277995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.278944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.279455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.284878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.285471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.285749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.286019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.286691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.288040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:57.294334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:57.295401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:57.296285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:57.296285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:57.296285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:57.296285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 531/1039] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:57.296285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.326998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 509/1040] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:25:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:25:57.326998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.408093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.416943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cc119-c719-42e4-b236-e41e42677aa8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.436410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae87139-5818-4472-9a1a-f0d567e0c7d5 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.455416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.456102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.457263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.457726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.458666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.460147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.463276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 532/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:57.467814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.475936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.476578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.477219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.477219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.478314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:57.478619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.480594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.494203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 510/1042] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:57.499749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.551064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.582575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef98a-f03c-4d56-a060-f8aeabee9ef6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.618083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abcfcb-4b05-4b5f-8b04-b4f4f87c377d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.623895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.624503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.624767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.625032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.625668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.627083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.659290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 533/1043] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:25:57 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:25:57.665214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.665866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.666141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.666407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.674770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.676855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:25:57.689570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:57.690790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:57.691941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 511/1044] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:57.696505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.717846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:57.810611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bb8e3-7fc4-4ac0-a738-f492b5fedbe9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.845928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:57.846452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:57.846725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:57.847049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:57.847811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:57.848108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:57.849519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:57.869208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 534/1045] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:57.875085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:57.975865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6db05-e5cc-4289-b01f-880db75f87d4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:57.977405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:58.010347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.010942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.011215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.011505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.077995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.079524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.177484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 512/1046] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:25:58.182856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:58.258581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:58.282750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b66f4-9015-42ed-ad1a-b6b4b0637f91 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:58.316305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.316929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.317197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.317457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.327398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.328820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:58.343136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:58.344095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:58.344987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:58.344987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:58.344987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:58.347759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 535/1047] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:58.350357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:58.352550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:58.453607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7306a7f-214b-4471-b0fa-1fd9f39d4d53 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:58.489350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.489948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.490221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.490484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.491115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:58.491440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.492781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.509113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 513/1048] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:58.510020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:58.618110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e894-b158-4da7-8628-967800dbb5f3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:58.644313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:58.653393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.654018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.654292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.654562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.661201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.662635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:25:58.673644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:58.674504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:58.675896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 536/1049] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:58.682634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:58.744965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:58.784386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855bb67-2743-4afd-a0c5-ea0348e12245 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:58.820288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.820898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.821177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.821446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.822140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:58.822442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.823884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01abc560-6c61-4234-9154-71433d5a2ac6 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.840942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 514/1050] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:25:58.842128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:58.947140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1f69-c570-4448-a924-24b665c79087 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:58.980483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:58.981084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:58.981363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:58.981631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:58.982350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] RBAC: Adding query filter params (role.id=c29a9cbc89b54a95ba7fb053937d5b5b, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:25:58.982653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:58.984099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694bd52-4b3b-4836-91b5-a4028e5e94e1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:58.995359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 537/1051] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:25:58 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=c29a9cbc89b54a95ba7fb053937d5b5b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:25:59.345281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7be71-2dab-458c-921f-a09685c6e983 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.345652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7be71-2dab-458c-921f-a09685c6e983 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.345832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7be71-2dab-458c-921f-a09685c6e983 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.347859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 515/1052] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:25:59.353186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120df59-6750-43f8-b1fa-ffa0f77be60d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.353472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120df59-6750-43f8-b1fa-ffa0f77be60d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.353736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120df59-6750-43f8-b1fa-ffa0f77be60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.371622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e120df59-6750-43f8-b1fa-ffa0f77be60d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:59.372789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e120df59-6750-43f8-b1fa-ffa0f77be60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:59.420781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:59.440750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 538/1053] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:59.462413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7be71-2dab-458c-921f-a09685c6e983 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:59.565447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7be71-2dab-458c-921f-a09685c6e983 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:59.589886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:59.603191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:59.604030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.604469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.605202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.673991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:59.675501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:59.704913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04212def-4b61-4582-8f2c-64c947385580 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.705428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04212def-4b61-4582-8f2c-64c947385580 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.705428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04212def-4b61-4582-8f2c-64c947385580 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.708023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 539/1054] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:25:59.712333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.712676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.713014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.730704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:25:59.731916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:25:59.781223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 516/1055] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:25:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:25:59.788175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:59.802830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 540/1056] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:25:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:25:59.811925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:59.825515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:59.892352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a5880-6f84-4688-b24e-7771ab7770be None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:59.925884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e63774-a4c4-4967-a79c-f4361a4eb782 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:25:59.929374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:59.929999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.930277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.930542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.939371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:25:59.941844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:25:59.943324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:25:59.959790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:59.960746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:25:59.961636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:25:59.961636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:25:59.961636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:25:59.961636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 517/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:25:59.966535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:25:59.967190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:25:59.967852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:25:59.968127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:25:59.968396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:25:59.979432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:25:59.984032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:25:59.984944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:25:59.985756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:25:59.990999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 541/1058] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:25:59.991719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:00.050887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:00.078565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c143f-9b0d-4a8d-873e-46539412714f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.095386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da447b0-694c-47f3-b345-d781d5c587a4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.115178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.115829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.116103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.116370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.117030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:00.117899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.119697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.132293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.133014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.133231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.133503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.134164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:00.134461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.147435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 518/1059] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:00.147618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.147618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 542/1060] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:00.151835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:00.260549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a4ba9-7d83-4af1-9a17-eb1d4de6c389 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.296799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.297462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.298858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.298858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] PATH_INFO: `/v3/users/3bc15bd626ac450da32e78b7c0ac90af` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.301274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:00.315039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] RBAC: Authorizing `identity:get_user(user_id=3bc15bd626ac450da32e78b7c0ac90af)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.317142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.318815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 519/1061] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:00 2022] GET /identity/v3/users/3bc15bd626ac450da32e78b7c0ac90af => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:00.324773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:00.362014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:00.432273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396521b-895e-4355-8088-2cfe289ba734 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.467071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.467738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.468017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.468285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.536845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.538298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.569734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:00.638104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 543/1062] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:00.644440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:00.739297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205c16-ec48-4d28-9320-dbdb9fa4de89 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.773562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.774178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.774450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.774715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.775821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.777244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41375-dcbf-40b8-b9e8-3d669c2ff8d8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.778848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 520/1063] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:00 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:00.785134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:00.881875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53acc57-46eb-489d-8c60-4993a0a2a890 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:00.915424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:00.916016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:00.916287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:00.916552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:00.917259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=be4633d47261401c8029aaedce28eda8, user.id=3bc15bd626ac450da32e78b7c0ac90af) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:00.917560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:00.918965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187b6b2-1097-447d-9d38-9e57506d70e0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:00.920694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:00.935338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 544/1064] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:00 2022] GET /identity/v3/role_assignments?user.id=3bc15bd626ac450da32e78b7c0ac90af&scope.project.id=be4633d47261401c8029aaedce28eda8&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:01.027212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad7f7-86fd-4e2c-8f40-c2a91d03f1ab None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.027745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad7f7-86fd-4e2c-8f40-c2a91d03f1ab None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.027745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad7f7-86fd-4e2c-8f40-c2a91d03f1ab None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.029048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 521/1065] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:01.034620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.034901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.035172 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.056757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:01.057962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:01.125478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 545/1066] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:01.147813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad7f7-86fd-4e2c-8f40-c2a91d03f1ab None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.207499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:01.248800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad7f7-86fd-4e2c-8f40-c2a91d03f1ab None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:01.280742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:01.281292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.281566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.281831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.292831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:01.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:01.298476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:01.299327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 522/1067] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:01.305007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.400145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da5bdc-395f-4d2a-977d-da5507029228 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:01.426687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:01.434878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:01.435495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.435771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.436034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.436686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:01.436979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:01.438332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:01.446075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 546/1068] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:01.451783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.552152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab21c8-8e9c-43ac-bfcf-46f89100344f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:01.571386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:01.585919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:01.586538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.586811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.587073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.600171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:01.601619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:26:01.616080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:01.617019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:26:01.618242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:26:01.618242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:01.618242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:01.618242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 523/1069] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:26:01.622879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.720725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b9ed8-230d-4cee-8e24-2f70cc833500 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:01.753073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:01.753698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.753979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.754250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.754884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:01.755183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:01.756591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:01.767890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 547/1070] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:01.773890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.880925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa188317-8b1a-4ca8-b244-164e457d18f0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:01.916559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:01.917178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:01.917456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:01.917724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:01.925069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:01.926506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:26:01.937348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:01.938353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:01.939322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 524/1071] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:01.944763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:01.994908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:02.045497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab933-b998-4414-80b9-1e12e4478b98 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.079927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.080528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.080810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.081081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.082654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:02.082957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.084424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.101089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 548/1072] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:26:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:02.106815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:02.137481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:02.213120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f5807-c3b6-4ec3-ba01-825a7fac615b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.256592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.257499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.257957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.258332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.271647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.273069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:26:02.286909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:02.288124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:26:02.289172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:26:02.289172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:02.289172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:02.289172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 525/1073] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:02.293724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:02.391074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ffd1c-76ac-4103-afd8-98d436ffcd1b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.400820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:02.424988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.426088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.426361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.426626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.427265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:02.427574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.428925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.439865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 549/1074] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:02.445579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:02.531752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:02.549931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e139-cfbf-4d54-a9e8-a40bc925309f None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.583275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.583959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.584236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.584506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.591190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.592653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:26:02.604285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:02.605356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:02.610904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 526/1075] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:26:02.611432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:02.709644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f6f7-56af-4490-8502-1f1bce5d3800 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.741829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.742427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.742704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.742975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.743681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:02.743982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.745407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f17a8-74eb-4493-b704-f4d72f84cdb7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.757764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 550/1076] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:02.764006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:02.861158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231fa42-52b6-42e0-b9de-f7344a1039b1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:02.890753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f1a-969f-4860-b445-30a91ef0fac7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.891040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f1a-969f-4860-b445-30a91ef0fac7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.891339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d55f1a-969f-4860-b445-30a91ef0fac7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.892678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 551/1077] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:26:02.897313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:02.897963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.898237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.898348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:02.898506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/c29a9cbc89b54a95ba7fb053937d5b5b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.898635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:02.898907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:02.900755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=54e2221204ff4332ba980b9c5779b05c, role_id=c29a9cbc89b54a95ba7fb053937d5b5b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:02.902166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:02.914955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 527/1078] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:26:02 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/54e2221204ff4332ba980b9c5779b05c/roles/c29a9cbc89b54a95ba7fb053937d5b5b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:26:02.919445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:02.919445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:02.943773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:02.990721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 552/1079] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:26:03.013055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:03.016941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:03.118847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df796e2-a0f1-49d1-bfd7-d41169781ebe None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:03.151745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:03.152389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:03.152666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:03.152935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:03.162603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:03.167787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:03.168720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:03.169549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 528/1080] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:03.174844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:03.271625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b476b6-ea9b-401f-8f48-f4a1c2ec2a10 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:03.304993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:03.305594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:03.305870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:03.306136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:03.306787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:03.307090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:03.308503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:03.316445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 553/1081] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:03.322189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:03.382705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:03.419760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd86d2-919c-4927-be5f-042f1abdae80 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:03.452282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:03.452990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:03.453268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:03.453536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] PATH_INFO: `/v3/users/3bc15bd626ac450da32e78b7c0ac90af` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:03.454621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] RBAC: Authorizing `identity:get_user(user_id=3bc15bd626ac450da32e78b7c0ac90af)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:03.456126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:03.458529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 529/1082] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:03 2022] GET /identity/v3/users/3bc15bd626ac450da32e78b7c0ac90af => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:03.464206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:03.485700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:03.565265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6222675-e72b-4185-ac95-0e2eff27d0e8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:03.599857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:03.600482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:03.600757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:03.601024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:03.602147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:03.603594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed6f02-3936-445f-9b3b-b976c5017fd7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:03.605206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 554/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:03 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:03.611038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:03.707813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a27e70-0a9d-4489-915e-cebd5c24268e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:03.735378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:03.740977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:03.741615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:03.741890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:03.742158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8/users/3bc15bd626ac450da32e78b7c0ac90af/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:03.744037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] RBAC: Authorizing `identity:create_grant(project_id=be4633d47261401c8029aaedce28eda8, user_id=3bc15bd626ac450da32e78b7c0ac90af, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:03.745451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3df68-2ab3-455e-96fa-03cc21e6525e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:03.758318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 530/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:26:03 2022] PUT /identity/v3/projects/be4633d47261401c8029aaedce28eda8/users/3bc15bd626ac450da32e78b7c0ac90af/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:26:04.878817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb314f6-8476-4b43-96d2-40eb1397ad28 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:04.879348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb314f6-8476-4b43-96d2-40eb1397ad28 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:04.879348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb314f6-8476-4b43-96d2-40eb1397ad28 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:04.880766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 555/1085] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:04.885720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:04.886222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:04.886315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:04.903975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:04.905163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:04.974981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 531/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:04.998096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb314f6-8476-4b43-96d2-40eb1397ad28 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.082955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:05.096269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb314f6-8476-4b43-96d2-40eb1397ad28 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.129358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.129921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.130198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.130467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.141528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:05.146161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:05.147057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 20:26:05.148156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:05.151555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 556/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 20:26:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:05.153213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.251679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73bbbcd-d11a-473f-9df3-351a166d8e22 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.273991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:05.287853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.288459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.288735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.289001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.289658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:05.289955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:05.291334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:05.299393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 532/1088] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:05.305089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.401793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a75040-541e-4635-8f11-1496136fc8a4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.434104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.434727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.435003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.435290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.445990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:05.447449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:05.455126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:26:05.462215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:05.463297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:26:05.464237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:26:05.464237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:05.464237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:05.468091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 557/1089] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:05.468934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.564160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be52823-ebd9-406e-b2ed-c785eda71a34 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.601226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.601397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.601676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.601948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.602613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:05.602920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:05.604321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551110f1-191a-4684-b26c-04873ddf3fd5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:05.616346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 533/1090] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:05.622016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.720635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578dfde-a77f-4c40-905e-9e355f909d11 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.731001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433b71-b053-438d-bf36-82a136e765a1 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.731311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433b71-b053-438d-bf36-82a136e765a1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.731589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433b71-b053-438d-bf36-82a136e765a1 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.732916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 534/1091] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:26:05.737617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.737905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.738171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.754130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.754752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.755029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.755326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.756306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:05.757487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:05.762712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:05.764168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:26:05.775592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:05.776678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 20:26:05.777727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:05.779388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 558/1092] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:05.782335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.799306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:05.827634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 535/1093] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:26:05.838946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:05.850891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.879896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcc2e1-7ec5-438b-bd1a-b40efa930f35 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.912399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.912994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.913266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.913529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.914238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:05.914532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:05.915969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:05.934458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 559/1094] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:05.940005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:05.948697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78da54-5496-4378-bd9a-aaab5ec65df1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:05.983577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:05.984118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:05.984390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:05.984655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:05.994496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:05.999072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:06.000082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:06.001434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 536/1095] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:26:06.007083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.041795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.052902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e40d-b2b0-4980-8c60-a49118d696ba None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.070235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.087359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.087955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.088229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.088489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.110708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e068f-bb3d-4e0b-a3ac-219ca2781d4e None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.144614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.145199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.145473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.145736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.146391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:06.146683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.148075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.155498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.156403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 537/1096] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.156936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.162004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.252860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.254728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 560/1097] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:26:06.259594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66453ed-1080-44cd-8341-5036404c3f25 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.260455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.277540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.294059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.294675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.294949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.295211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] PATH_INFO: `/v3/users/3bc15bd626ac450da32e78b7c0ac90af` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.296344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] RBAC: Authorizing `identity:get_user(user_id=3bc15bd626ac450da32e78b7c0ac90af)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.297754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.299326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 538/1098] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/users/3bc15bd626ac450da32e78b7c0ac90af => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.305503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.358225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52f0a8-5dba-4d7f-9a52-72e72251c754 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.392798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.393416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.393692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.393996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.403765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.405193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.416605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f36be-1efa-4517-b5f2-245241eb3169 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:26:06.419839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:06.420737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:26:06.421615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:26:06.421615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:26:06.421615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:06.423514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 561/1099] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:26:06.427094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.450435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.451034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.451343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.451614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.482013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.495576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.519206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.520620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.525774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6e404-4639-4f11-94b3-bb050288913f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.559220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.559831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.560103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.560369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.560990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:06.561283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.562616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.573972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 562/1100] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.579526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.621682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 539/1101] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:26:06.627493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.679185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f706-fe6e-41c0-b78a-12e54293bc1f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.688186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.707684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.713516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.714138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.714412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.714678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.721270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.723208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.725737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4788-a266-4f01-9810-6394b98981ca None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:26:06.734055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:06.734918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:06.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 563/1102] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:26:06.741470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.759903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.760517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.760792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.761057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.762155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.763610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.765225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 540/1103] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.771699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.840873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b05ce8-f865-4ccb-89d8-7e30ecd941d7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.868551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e100c7d-8008-4c90-bd90-0251208cad48 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:06.874122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.874719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.874995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.875284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.875972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:06.876273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.877691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.889437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 564/1104] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.895945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:06.897092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:06.902344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:06.902935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:06.903209 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:06.903508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:06.904219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=be4633d47261401c8029aaedce28eda8, user.id=3bc15bd626ac450da32e78b7c0ac90af) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:06.904517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:06.905910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea65d4-07f7-495a-8491-0222c9985941 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:06.912560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 541/1105] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/role_assignments?user.id=3bc15bd626ac450da32e78b7c0ac90af&scope.project.id=be4633d47261401c8029aaedce28eda8&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:06.949391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:07.001510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3934-4dc3-47fe-b0fb-3535b2e11260 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:07.037402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:07.037919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:07.038194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:07.038461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:07.039184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] RBAC: Adding query filter params (role.id=c29a9cbc89b54a95ba7fb053937d5b5b, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=54e2221204ff4332ba980b9c5779b05c) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:07.039514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:07.040957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e10290-5a0a-4fc2-911b-7d1bc136ce85 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:07.047256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 565/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:06 2022] GET /identity/v3/role_assignments?user.id=54e2221204ff4332ba980b9c5779b05c&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=c29a9cbc89b54a95ba7fb053937d5b5b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:08.924165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d51-8e02-4b9b-8f65-e18704f7ef55 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:08.924678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d51-8e02-4b9b-8f65-e18704f7ef55 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:08.924678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791d51-8e02-4b9b-8f65-e18704f7ef55 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:08.926522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 542/1107] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:08.931552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:08.931932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:08.932096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:08.949610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:08.950787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:09.017169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 566/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:09.041768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791d51-8e02-4b9b-8f65-e18704f7ef55 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:09.137697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791d51-8e02-4b9b-8f65-e18704f7ef55 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:09.169675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:09.170270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:09.170542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:09.170804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:09.171896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:09.173295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c9dd4-1b25-44e3-a3e7-8f57438fedfc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:09.174842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 543/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:09.180716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:09.224277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:09.277022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710be14-a71d-4c5e-9a4a-2d5af20ee8f5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:09.310476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:09.311072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:09.311378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:09.311652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:09.312284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:09.313699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f069d-7acf-4ac2-8d06-55e83755d4f9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:09.334487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 567/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:26:09 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:26:11.338013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd07e7-4060-40d9-8bde-6f3d92b4708a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:11.338541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd07e7-4060-40d9-8bde-6f3d92b4708a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:11.338541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd07e7-4060-40d9-8bde-6f3d92b4708a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:11.339901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 544/1111] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:11.344994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:11.345400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:11.345538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:11.363656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:11.364821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:11.434881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 568/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:11.458639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd07e7-4060-40d9-8bde-6f3d92b4708a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:11.518277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:11.554468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd07e7-4060-40d9-8bde-6f3d92b4708a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:11.586539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:11.587142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:11.587447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:11.587711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] PATH_INFO: `/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:11.589154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] RBAC: Authorizing `identity:get_role(role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:11.590440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:11.591759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 545/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:11 2022] GET /identity/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:26:11.597901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:11.626889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:11.703598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05861fb3-027d-458d-8840-818aa3b130f1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:11.740304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:11.740923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:11.741200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:11.741468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] PATH_INFO: `/v3/users/38c937901cb2407d966b338fd7ef9d36` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:11.753989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] RBAC: Authorizing `identity:get_user(user_id=38c937901cb2407d966b338fd7ef9d36)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:11.755439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:11.756993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 569/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:11 2022] GET /identity/v3/users/38c937901cb2407d966b338fd7ef9d36 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:11.762769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:11.858045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96d9ee-da99-4c1e-a2c0-755fe445e84a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:11.885784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:11.890885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:11.891499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:11.891775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:11.892042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:11.955667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:11.957659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:12.055913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 546/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:12.061732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:12.145255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:12.157261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713a011-a81f-4323-b07a-e6f3552ff138 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:12.189833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:12.190441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:12.190712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:12.190981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:12.192098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:12.193501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84013a48-b920-4fe3-a392-3d2e9bb96d0f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:12.195076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 570/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:12 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:12.201089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:12.230992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:12.296534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013f32c-d539-4c79-936e-586fcea2ea46 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:12.329002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:12.329579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:12.329849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:12.330112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:12.330811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=be4633d47261401c8029aaedce28eda8, user.id=38c937901cb2407d966b338fd7ef9d36) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:12.331110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:12.332794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a280c-abc8-4f37-b6f7-30bdf1a97bb4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:12.338377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 547/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:12 2022] GET /identity/v3/role_assignments?user.id=38c937901cb2407d966b338fd7ef9d36&scope.project.id=be4633d47261401c8029aaedce28eda8&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:14.276665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7bce0-d65e-4c50-bf3d-b3100f9f795a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.277216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7bce0-d65e-4c50-bf3d-b3100f9f795a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.277216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7bce0-d65e-4c50-bf3d-b3100f9f795a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.278583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 571/1118] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:14.283749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.284115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.284286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.301639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:14.303521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:14.366700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 548/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:14.388667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7bce0-d65e-4c50-bf3d-b3100f9f795a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:14.487083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7bce0-d65e-4c50-bf3d-b3100f9f795a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:14.520228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:14.520860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.521135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.521397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] PATH_INFO: `/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.522743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] RBAC: Authorizing `identity:get_role(role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:14.524121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:14.525407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 572/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:14 2022] GET /identity/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:14.531445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:14.557031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:14.626933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc39924-680e-4a4a-b11a-85b05ecb9f81 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:14.658679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:14.659306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.659586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.659845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] PATH_INFO: `/v3/users/38c937901cb2407d966b338fd7ef9d36` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.660925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] RBAC: Authorizing `identity:get_user(user_id=38c937901cb2407d966b338fd7ef9d36)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:14.662859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:14.664427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 549/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:14 2022] GET /identity/v3/users/38c937901cb2407d966b338fd7ef9d36 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:14.670178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:14.694757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:14.768068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a1ce0-74c4-4033-ad38-5367248bd2a5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:14.800246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:14.800797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.801069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.801334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.802957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:14.804395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ae075-2f89-4f07-8c4f-c4476d69069d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:14.805968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 573/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:14 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:14.811923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:14.900682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:14.907393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b11da9-8571-4e8c-a69e-321ce183b744 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:14.940061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:14.940695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:14.940971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:14.941239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8/users/38c937901cb2407d966b338fd7ef9d36/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:14.943380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=be4633d47261401c8029aaedce28eda8, user_id=38c937901cb2407d966b338fd7ef9d36, role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:14.944825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37072232-677e-43e2-8882-2d02e56bc1e2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:14.956457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 550/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:26:14 2022] PUT /identity/v3/projects/be4633d47261401c8029aaedce28eda8/users/38c937901cb2407d966b338fd7ef9d36/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:26:16.939343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef669e7-108b-4081-985e-a0b4671b9225 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:16.939897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef669e7-108b-4081-985e-a0b4671b9225 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:16.939897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef669e7-108b-4081-985e-a0b4671b9225 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:16.941113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 574/1124] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:16.946265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:16.946706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:16.946815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:16.964513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:16.965683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:17.029453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 551/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:17.052798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef669e7-108b-4081-985e-a0b4671b9225 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:17.139820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:17.149326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef669e7-108b-4081-985e-a0b4671b9225 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:17.182092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:17.182698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:17.182968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:17.183230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] PATH_INFO: `/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:17.184598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] RBAC: Authorizing `identity:get_role(role_id=d3cc34f19e334ea5befdd6cc76f3444e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:17.185936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:17.187199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 575/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:17 2022] GET /identity/v3/roles/d3cc34f19e334ea5befdd6cc76f3444e => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:17.192854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:17.272042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:17.288864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56e97c-7f77-4351-9fb1-05faaab8389c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:17.321322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:17.321932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:17.322208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:17.322479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] PATH_INFO: `/v3/users/38c937901cb2407d966b338fd7ef9d36` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:17.323595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] RBAC: Authorizing `identity:get_user(user_id=38c937901cb2407d966b338fd7ef9d36)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:17.324998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:17.326534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 552/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:17 2022] GET /identity/v3/users/38c937901cb2407d966b338fd7ef9d36 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:17.332358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:17.430057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09356b-6688-4a2a-94c1-42df1d5bba7f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:17.462560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:17.463089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:17.463392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:17.463657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:17.490452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:17.528491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:17.529912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:17.623011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 576/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:17.628805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:17.731777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f9ffd-52ae-4a92-9744-81f566ed4d0a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:17.770519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:17.771817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:17.772092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:17.772358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] PATH_INFO: `/v3/projects/be4633d47261401c8029aaedce28eda8` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:17.773466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] RBAC: Authorizing `identity:get_project(project_id=be4633d47261401c8029aaedce28eda8)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:17.774903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92f6e8-3383-43a6-9e6d-c077f6ce71b0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:17.776552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 553/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:17 2022] GET /identity/v3/projects/be4633d47261401c8029aaedce28eda8 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:17.782667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:17.839214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:17.877911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb77753-cedb-4e61-aa4b-4a22e9a764c0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:17.911210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:17.911832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:17.912109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:17.912378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:17.913100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] RBAC: Adding query filter params (role.id=d3cc34f19e334ea5befdd6cc76f3444e, scope.project.id=be4633d47261401c8029aaedce28eda8, user.id=38c937901cb2407d966b338fd7ef9d36) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:17.913404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:17.914808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241138e-ea9e-4b93-b937-d28c9c65ac1e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:17.920384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 577/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:17 2022] GET /identity/v3/role_assignments?user.id=38c937901cb2407d966b338fd7ef9d36&scope.project.id=be4633d47261401c8029aaedce28eda8&role.id=d3cc34f19e334ea5befdd6cc76f3444e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:19.923480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d43b-7d7c-4b60-bb7d-a7911ebbb038 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:19.923978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d43b-7d7c-4b60-bb7d-a7911ebbb038 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:19.923978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172d43b-7d7c-4b60-bb7d-a7911ebbb038 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:19.925254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 554/1131] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:19.930362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:19.930802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:19.930905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:19.948990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:19.950167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:20.014958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 578/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:20.037450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d43b-7d7c-4b60-bb7d-a7911ebbb038 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:20.058089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:20.134574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172d43b-7d7c-4b60-bb7d-a7911ebbb038 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:20.166326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:20.166932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:20.167203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:20.167493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:20.168563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:20.169950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a6ea-b76a-4327-bd77-bd87828b9637 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:20.171478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 555/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:20.177327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:20.230303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:20.273289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c566e46-4a4f-47de-88bf-bcfee3498bfe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:20.305717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:20.306306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:20.306583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:20.306852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:20.307513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:20.308914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc895990-2cfa-4fee-a59f-37553f763d0f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:20.334643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 579/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:26:20 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:26:22.346343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9076d-78d4-4c06-bda4-83ef4789dd48 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:22.346892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9076d-78d4-4c06-bda4-83ef4789dd48 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:22.346892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9076d-78d4-4c06-bda4-83ef4789dd48 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:22.348246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 556/1135] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:22.353767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:22.354200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:22.354293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:22.372388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:22.373554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:22.437634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 580/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:22.462204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9076d-78d4-4c06-bda4-83ef4789dd48 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:22.547487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:22.560246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9076d-78d4-4c06-bda4-83ef4789dd48 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:22.592784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:22.593392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:22.593668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:22.593936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:22.595022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:22.596524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e8b6-23da-43fd-acc5-f1146d4f5d4e None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:22.598022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 557/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:22.604140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:22.637252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:22.700453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932326fb-af83-4dd2-a8aa-28993cc4a5d4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:22.734372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:22.734962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:22.735237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:22.735654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:22.736290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:22.737700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14b63b-9d83-4091-9f95-6b8f6662fb66 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:22.757295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 581/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:26:22 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:26:24.770206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf658-d827-42d7-8fb4-bfed21626823 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:24.770718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf658-d827-42d7-8fb4-bfed21626823 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:24.770718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf658-d827-42d7-8fb4-bfed21626823 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:24.772570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 558/1139] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:24.777684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:24.778106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:24.778234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:24.796377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:24.797557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:24.861381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 582/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:24.883962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cf658-d827-42d7-8fb4-bfed21626823 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:24.981038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cf658-d827-42d7-8fb4-bfed21626823 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.013931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.014529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.014802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.015065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.024747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:25.029296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:25.030439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:25.031695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 559/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:25.036179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:25.059461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:25.132696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb207-212b-4cf0-a782-d5cc3b9ff846 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.164933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.165527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.165803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.166073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.166726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:25.167023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:25.168411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:25.176074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 583/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:25.182623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:25.201613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:25.280095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bd4a-ba5a-4f1a-a0fc-9abf09721f70 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.312678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.313289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.313565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.313834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] PATH_INFO: `/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.326758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=4b3a48cc8a9744aabb0a8872e2b7495b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:25.328202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:25.329749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 560/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:25 2022] GET /identity/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:25.336165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:25.417745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:25.433230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616983b6-6f6a-4c92-a5fb-e30f550b7c96 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.465972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.466570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.466849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.467123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.532566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:25.533992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:25.613507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:25.629787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 584/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:25.635600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:25.706766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:25.731567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac612b07-1b7c-46a8-ada7-97b8dd579fb0 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.763670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.764277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.764549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.764812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] PATH_INFO: `/v3/projects/6b1a77f33d2440b99fa533fa79ac444f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.765894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] RBAC: Authorizing `identity:get_project(project_id=6b1a77f33d2440b99fa533fa79ac444f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:25.767328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30386218-a1dc-44b4-b466-23b985e260ce None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:25.768895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 561/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:25 2022] GET /identity/v3/projects/6b1a77f33d2440b99fa533fa79ac444f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:25.775360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:25.870717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddcc86-b442-4656-8b93-56bb59765523 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:25.904000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:25.904585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:25.904859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:25.905126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:25.905832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=6b1a77f33d2440b99fa533fa79ac444f, user.id=4b3a48cc8a9744aabb0a8872e2b7495b) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:25.906135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:25.907571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857862d3-b0e1-44bb-9dcb-3a0f99c6b9bc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:25.912707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 585/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:25 2022] GET /identity/v3/role_assignments?user.id=4b3a48cc8a9744aabb0a8872e2b7495b&scope.project.id=6b1a77f33d2440b99fa533fa79ac444f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:27.874036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c704de-f5bb-4525-9d7a-211dbc770bb3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:27.874528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c704de-f5bb-4525-9d7a-211dbc770bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:27.874528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c704de-f5bb-4525-9d7a-211dbc770bb3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:27.875849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 562/1147] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:27.881555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:27.881950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:27.882095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:27.900283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:27.901458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:27.943940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:27.966913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 586/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:27.988624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c704de-f5bb-4525-9d7a-211dbc770bb3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:28.084735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c704de-f5bb-4525-9d7a-211dbc770bb3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:28.117164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:28.117760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:28.118031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:28.118294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:28.127806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:28.132333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:28.133399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:28.134553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 563/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:28.139039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:28.238425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbec4d-20c9-4f34-ac25-9db818402e1d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:28.270751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:28.271364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:28.271640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:28.271907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:28.272557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:28.272854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:28.274204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:28.281928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 587/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:28.288234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:28.291613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:28.385739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45223f-d107-4685-90b6-9941ffbce9ba None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:28.418235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:28.418841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:28.419117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:28.419417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] PATH_INFO: `/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:28.420509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] RBAC: Authorizing `identity:get_user(user_id=4b3a48cc8a9744aabb0a8872e2b7495b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:28.421909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:28.423467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 564/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:28 2022] GET /identity/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:28.429548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:28.470212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:28.526598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c871b-05ef-4357-92fc-ed7956b5ea51 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:28.558619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:28.559227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:28.559533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:28.559804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] PATH_INFO: `/v3/projects/6b1a77f33d2440b99fa533fa79ac444f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:28.560889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6b1a77f33d2440b99fa533fa79ac444f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:28.562302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88235b3e-2cd5-4258-bfdd-f5575c4798f0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:28.563920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 588/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:28 2022] GET /identity/v3/projects/6b1a77f33d2440b99fa533fa79ac444f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:28.569548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:28.635657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:28.665658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca05d7-ac61-4e3e-9300-66e73171f471 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:28.697171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:28.697811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:28.698087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:28.698356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] PATH_INFO: `/v3/projects/6b1a77f33d2440b99fa533fa79ac444f/users/4b3a48cc8a9744aabb0a8872e2b7495b/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:28.700253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=6b1a77f33d2440b99fa533fa79ac444f, user_id=4b3a48cc8a9744aabb0a8872e2b7495b, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:28.701659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190815c7-9e14-4b7d-8902-894cdd222ddc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:28.715171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 565/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:26:28 2022] PUT /identity/v3/projects/6b1a77f33d2440b99fa533fa79ac444f/users/4b3a48cc8a9744aabb0a8872e2b7495b/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:26:30.646620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108af7-0914-45bf-8219-3f568de2673b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:30.647054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108af7-0914-45bf-8219-3f568de2673b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:30.647159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56108af7-0914-45bf-8219-3f568de2673b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:30.648502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 589/1154] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:30.653510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:30.653893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:30.654051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:30.672344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:30.673503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:30.737288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 566/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:26:30.759230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108af7-0914-45bf-8219-3f568de2673b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:30.856260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56108af7-0914-45bf-8219-3f568de2673b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:30.864593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:30.889047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:30.889655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:30.889929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:30.890196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:30.900911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:30.905485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:30.906551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:30.907789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 590/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:30.913077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:30.968422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:31.008253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4222-580b-4015-8f7d-1355d6c0b390 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:31.041067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:31.041657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:31.041934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:31.042202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:31.042869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:31.043148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:31.044556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:31.052247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 567/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:31.057931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:31.155337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54f18-8c41-4988-b5c7-58e05d6e24ef None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:31.187703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:31.188319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:31.188591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:31.188859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] PATH_INFO: `/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:31.189949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] RBAC: Authorizing `identity:get_user(user_id=4b3a48cc8a9744aabb0a8872e2b7495b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:31.191400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:31.193467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 591/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:31 2022] GET /identity/v3/users/4b3a48cc8a9744aabb0a8872e2b7495b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:31.199203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:31.294823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b991f1-bf2e-4ffe-9105-0fea89bc8d0a None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:31.315483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:31.327375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:31.327955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:31.328226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:31.328491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:31.391746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:31.393156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:31.491439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 568/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:31.497246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:31.531251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:31.594448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e645b4f-d7e2-4f05-8d19-ead515bc6f31 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:31.627337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:31.627950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:31.628226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:31.628495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] PATH_INFO: `/v3/projects/6b1a77f33d2440b99fa533fa79ac444f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:31.629591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] RBAC: Authorizing `identity:get_project(project_id=6b1a77f33d2440b99fa533fa79ac444f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:31.631023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5f918-4e17-4431-a9ab-c041982bfcce None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:31.632649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 592/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:31 2022] GET /identity/v3/projects/6b1a77f33d2440b99fa533fa79ac444f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:31.638691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:31.662756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:31.735635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8903c-5c34-4b09-a46c-9e04954393a8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:31.771860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:31.772416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:31.772700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:31.772970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:31.773694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=6b1a77f33d2440b99fa533fa79ac444f, user.id=4b3a48cc8a9744aabb0a8872e2b7495b) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:31.774001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:31.775448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140378e-e881-485b-9a8d-010b01a72f9a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:31.781347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 569/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:31 2022] GET /identity/v3/role_assignments?user.id=4b3a48cc8a9744aabb0a8872e2b7495b&scope.project.id=6b1a77f33d2440b99fa533fa79ac444f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:33.761563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507c62-cbe0-46da-9413-f2f1f07c2057 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:33.762151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507c62-cbe0-46da-9413-f2f1f07c2057 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:33.762151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507c62-cbe0-46da-9413-f2f1f07c2057 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:33.763545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 593/1162] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:33.768661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:33.769063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:33.769207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:33.787869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:33.789072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:33.851970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 570/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:33.873574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d507c62-cbe0-46da-9413-f2f1f07c2057 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:33.971040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d507c62-cbe0-46da-9413-f2f1f07c2057 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:33.973297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:34.003360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:34.003941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:34.004214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:34.004479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:34.068714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:34.070134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:34.163602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 594/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:34.169638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:34.186787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:34.264247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307fdbb-5ced-4e74-8b28-1a02b7d89d0c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:34.296611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:34.297216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:34.297489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:34.297755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:34.304235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:34.305642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-fe8f6862-a37c-4dbf-ad61-4769ea18ce11 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:34.316422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:34.318232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 20:26:34.319290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:34.322815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 571/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:26:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:34.323819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:34.326855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:34.427049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb330d-01f5-4e59-a988-df8e123ad15e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:34.465014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:34.465616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:34.465892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:34.466163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:34.466794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:34.467097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:34.468486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a210f-0d56-4cfc-b00f-72260eaff793 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:34.475489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 595/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 20:26:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:36.432671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a7930-a57a-479b-9e7c-bac906db3d6b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:36.433237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a7930-a57a-479b-9e7c-bac906db3d6b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:36.433237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a7930-a57a-479b-9e7c-bac906db3d6b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:36.434537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 572/1167] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:36.439547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3d833-8d88-46a2-acbe-c0f14c267614 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:36.439947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3d833-8d88-46a2-acbe-c0f14c267614 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:36.440085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3d833-8d88-46a2-acbe-c0f14c267614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:36.457939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d0a3d833-8d88-46a2-acbe-c0f14c267614 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:36.459188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0a3d833-8d88-46a2-acbe-c0f14c267614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:36.519257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:36.525522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 596/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:36.547466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a7930-a57a-479b-9e7c-bac906db3d6b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:36.625070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:36.648859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a7930-a57a-479b-9e7c-bac906db3d6b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:36.680277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:36.680860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:36.681132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:36.681396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:36.682042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:36.683458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5723384-13a5-4109-a91a-77d690a316fe None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:36.698383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 573/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Sat Aug 6 20:26:36 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:26:38.727841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf610a-3340-41db-8ee9-d51da39e6f55 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:38.728346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf610a-3340-41db-8ee9-d51da39e6f55 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:38.728437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf610a-3340-41db-8ee9-d51da39e6f55 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:38.729714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 597/1170] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:38.734872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:38.735309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:38.735463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:38.753654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:38.754827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:38.818606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 574/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:38.841151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf610a-3340-41db-8ee9-d51da39e6f55 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:38.942306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf610a-3340-41db-8ee9-d51da39e6f55 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:38.975296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:38.975907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:38.976179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:38.976445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] PATH_INFO: `/v3/domains/1e4ca06c4b9d4329b456038430a2ba93` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:38.986324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e4ca06c4b9d4329b456038430a2ba93)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:38.987780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80521b41-8868-4684-bc08-a60e2486cd71 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:38.989335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 598/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Aug 6 20:26:38 2022] GET /identity/v3/domains/1e4ca06c4b9d4329b456038430a2ba93 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:38.995363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:39.056004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:39.089703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43343-b0eb-470d-85a5-662dacbc064a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:39.122182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:39.122771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:39.123046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:39.123340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:39.123976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:39.125381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97ac6-11a1-4ac4-a6ae-75de44adf6d0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:39.150672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 575/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:26:38 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:26:41.120627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10770d-2a31-4698-b204-5bb144b870f3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:41.121142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10770d-2a31-4698-b204-5bb144b870f3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:41.121142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10770d-2a31-4698-b204-5bb144b870f3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:41.122480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 599/1174] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:41.127674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:41.128064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:41.128219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:41.146884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:41.148094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:41.211618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 576/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:41.235216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10770d-2a31-4698-b204-5bb144b870f3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:41.292583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:41.333886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10770d-2a31-4698-b204-5bb144b870f3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:41.365452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:41.366056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:41.366329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:41.366591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] PATH_INFO: `/v3/domains/1e4ca06c4b9d4329b456038430a2ba93` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:41.367691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=1e4ca06c4b9d4329b456038430a2ba93)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:41.369094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714add3-2428-4532-ab47-a19a9fe9de2f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:41.370599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 600/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Aug 6 20:26:41 2022] GET /identity/v3/domains/1e4ca06c4b9d4329b456038430a2ba93 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:41.376237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:41.422436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:41.471021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333064-9f21-432c-bc61-f40d0a4bfb86 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:41.504391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:41.505010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:41.505288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:41.505555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:41.506191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:41.507640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698cf68-9e5f-411f-a1b1-85a675f3b082 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:41.527663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 577/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:26:41 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:26:43.551016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964148-e47d-41a9-b154-c63810ad19ae None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:43.551599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964148-e47d-41a9-b154-c63810ad19ae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:43.551599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964148-e47d-41a9-b154-c63810ad19ae None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:43.553373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 601/1178] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:43.558510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485372-0a88-47a9-b59d-1847930b524b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:43.558953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485372-0a88-47a9-b59d-1847930b524b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:43.559052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62485372-0a88-47a9-b59d-1847930b524b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:43.577227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-62485372-0a88-47a9-b59d-1847930b524b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:43.578411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-62485372-0a88-47a9-b59d-1847930b524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:43.642876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 578/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:43.665130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964148-e47d-41a9-b154-c63810ad19ae None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:43.764026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964148-e47d-41a9-b154-c63810ad19ae None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:43.787954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:43.796538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:43.797145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:43.797418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:43.797680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:43.808354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:43.812855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:43.813997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:43.815020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 602/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:43.820545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485372-0a88-47a9-b59d-1847930b524b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:43.852813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:43.918254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62485372-0a88-47a9-b59d-1847930b524b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:43.950941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:43.951557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:43.951834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:43.952100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:43.952752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:43.953049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:43.954397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:43.962291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 579/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:43.967897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:44.064182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4cfd1-59d9-431a-b54d-2e1dcf5ddaa3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:44.095785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:44.096389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:44.096667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:44.096936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] PATH_INFO: `/v3/users/c00c59475c614b469fc26a7c99c995e5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:44.109897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] RBAC: Authorizing `identity:get_user(user_id=c00c59475c614b469fc26a7c99c995e5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:44.111350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:44.112879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 603/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:43 2022] GET /identity/v3/users/c00c59475c614b469fc26a7c99c995e5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:44.118552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:44.207951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:44.214295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c310a-d7e3-4441-aac1-49a68daf87e3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:44.247170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:44.247781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:44.248057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:44.248324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:44.314149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:44.315661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:44.403446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:44.410437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 580/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:44.416438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:44.461246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:44.513089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf0f55-9899-47c2-960e-dfd0b3b082bd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:44.545016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:44.545624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:44.545899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:44.546167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] PATH_INFO: `/v3/projects/7886406710f34b929a093648a59c08d5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:44.547271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] RBAC: Authorizing `identity:get_project(project_id=7886406710f34b929a093648a59c08d5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:44.548684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe5a3d-9bd5-4684-8bc2-655574e8cc27 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:44.550256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 604/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:44 2022] GET /identity/v3/projects/7886406710f34b929a093648a59c08d5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:44.556714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:44.652386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d9a75-6847-4dfc-b9d5-b78dd748d5c1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:44.685314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:44.685903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:44.686182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:44.686478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:44.687194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=7886406710f34b929a093648a59c08d5, user.id=c00c59475c614b469fc26a7c99c995e5) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:44.687530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:44.688936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf8294-de2b-4267-a4d1-779536f2bc39 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:44.694089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 581/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:44 2022] GET /identity/v3/role_assignments?user.id=c00c59475c614b469fc26a7c99c995e5&scope.project.id=7886406710f34b929a093648a59c08d5&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:46.628669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e57be-6392-4453-9601-486656238051 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:46.629084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e57be-6392-4453-9601-486656238051 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:46.629214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e57be-6392-4453-9601-486656238051 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:46.630566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 605/1186] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:46.635608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:46.635999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:46.636153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:46.654200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:46.655407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:46.708789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:46.720176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 582/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:46.742375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e57be-6392-4453-9601-486656238051 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:46.844778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e57be-6392-4453-9601-486656238051 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:46.857784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:46.878471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:46.879082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:46.879392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:46.879658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:46.889303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:46.893889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:46.894940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:26:46.896037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 606/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:46.901003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:46.995618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c7443-ac2f-41e3-827f-da4c0d07141f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:47.027795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:47.028380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:47.028654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:47.028920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:47.029565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:47.029861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:47.031220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:47.039434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 583/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:47.044821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:47.154356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc24c05-422f-4d1a-bd08-d6d37ab85240 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:47.185926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:47.186541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:47.186812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:47.187076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] PATH_INFO: `/v3/users/c00c59475c614b469fc26a7c99c995e5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:47.188194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] RBAC: Authorizing `identity:get_user(user_id=c00c59475c614b469fc26a7c99c995e5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:47.189605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:47.191357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 607/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:47 2022] GET /identity/v3/users/c00c59475c614b469fc26a7c99c995e5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:47.197590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:47.249216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:47.294488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0517-0726-445c-a4ac-a53f78304d67 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:47.326870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:47.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:47.327860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:47.328124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] PATH_INFO: `/v3/projects/7886406710f34b929a093648a59c08d5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:47.329212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] RBAC: Authorizing `identity:get_project(project_id=7886406710f34b929a093648a59c08d5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:47.330621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e3f9-b67c-480c-bb34-e2f3e6587c31 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:47.332246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 584/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:47 2022] GET /identity/v3/projects/7886406710f34b929a093648a59c08d5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:47.338407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:47.378585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:47.433920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5f9c9-8ba3-42b3-82a0-1ecc7919d884 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:47.466588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:47.467220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:47.467521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:47.467784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] PATH_INFO: `/v3/projects/7886406710f34b929a093648a59c08d5/users/c00c59475c614b469fc26a7c99c995e5/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:47.469618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] RBAC: Authorizing `identity:create_grant(project_id=7886406710f34b929a093648a59c08d5, user_id=c00c59475c614b469fc26a7c99c995e5, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:47.471017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900115-06c8-4b5a-b7ab-020c94734709 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:47.483857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 608/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:26:47 2022] PUT /identity/v3/projects/7886406710f34b929a093648a59c08d5/users/c00c59475c614b469fc26a7c99c995e5/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:26:49.424874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f894e-6772-4543-b552-e81a42cd3353 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:49.425424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f894e-6772-4543-b552-e81a42cd3353 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:49.425424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f894e-6772-4543-b552-e81a42cd3353 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:49.426762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 585/1193] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:26:49.432362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:49.432739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:49.432901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:49.450302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:26:49.451486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:26:49.514694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 609/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:26:49.538233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f894e-6772-4543-b552-e81a42cd3353 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:49.635130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f894e-6772-4543-b552-e81a42cd3353 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:49.653919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:49.668271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:49.668880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:49.669151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:49.669415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:49.679502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:26:49.684021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:26:49.685091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:26:49.685990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 586/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:26:49.691047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:49.720012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:49.787094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd5f58-e038-4486-9f3d-c46ab5846037 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:49.832506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:49.834123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:49.834563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:49.835005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:49.835773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:49.836073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:49.837474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:49.847636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 610/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:49.854015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:49.949962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9305e2-dcbf-4dd0-a00b-e148751b0b61 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:49.982155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:49.982778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:49.983054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:49.983353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] PATH_INFO: `/v3/users/c00c59475c614b469fc26a7c99c995e5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:49.984452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] RBAC: Authorizing `identity:get_user(user_id=c00c59475c614b469fc26a7c99c995e5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:49.985869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:49.987440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 587/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 20:26:49 2022] GET /identity/v3/users/c00c59475c614b469fc26a7c99c995e5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:49.993262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:50.081107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:50.090505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3cd4b-5efa-4449-b2a6-46a61c989570 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:50.141956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:50.142581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:50.142862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:50.143134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:50.211287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:50.212639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:50.297597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:50.307656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 611/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:26:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:26:50.313491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:50.360674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:26:50.409498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35836c90-93df-4308-82a7-7b5c0c68214c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:50.441361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:50.441967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:50.442238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:50.443087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] PATH_INFO: `/v3/projects/7886406710f34b929a093648a59c08d5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:50.444206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] RBAC: Authorizing `identity:get_project(project_id=7886406710f34b929a093648a59c08d5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:50.445618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ab646-79c9-45ed-814c-9d52ffdf905f None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:50.447187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 588/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 20:26:50 2022] GET /identity/v3/projects/7886406710f34b929a093648a59c08d5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:26:50.453122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:26:50.548528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4fae0-eb5b-48fa-8bc4-9eb68a62a87b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:26:50.582146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:26:50.582732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:26:50.583770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:26:50.584034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:26:50.584743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=7886406710f34b929a093648a59c08d5, user.id=c00c59475c614b469fc26a7c99c995e5) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:26:50.585043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:26:50.586445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8081dc2-783e-4635-9d31-81819714112c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:26:50.592131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 612/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:26:50 2022] GET /identity/v3/role_assignments?user.id=c00c59475c614b469fc26a7c99c995e5&scope.project.id=7886406710f34b929a093648a59c08d5&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:00.437323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=42 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:00.589568 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=72 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:45.900547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dc12-c698-48be-97ed-fc3aa7bf539a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:45.901177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dc12-c698-48be-97ed-fc3aa7bf539a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:45.901332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226dc12-c698-48be-97ed-fc3aa7bf539a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:45.902684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 589/1201] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:27:45.908880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:45.909374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:45.909469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:45.931383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:27:45.932989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:27:46.024794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 613/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:27:46.049046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226dc12-c698-48be-97ed-fc3aa7bf539a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:46.196490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226dc12-c698-48be-97ed-fc3aa7bf539a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:46.244868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:46.245572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:46.245852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:46.246181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:46.263132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:46.264930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:46.284443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:46.285606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:46.286560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:46.286560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:46.286560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:46.287122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 590/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:46.296881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:46.462569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a7fb-4e38-4cef-98df-f278f521a08d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:46.511280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:46.518812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:46.519451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:46.519727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:46.520011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:46.520656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:46.520931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:46.522898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608c31-c01f-4b41-acf0-560229b1c14c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:46.539291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 614/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:46.544809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:46.620827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:46.682061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e5a54-1aff-4aaa-abf9-c93f38a5da25 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:46.735601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:46.736578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:46.737185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:46.737659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:46.738487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:46.740894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b71c89-3868-451d-a52e-a9670adf8165 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:46.767296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 591/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 20:27:46 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:27:49.350537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fdf7-7482-41a1-b504-23b120aa9dfb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:49.351282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fdf7-7482-41a1-b504-23b120aa9dfb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:49.351585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901fdf7-7482-41a1-b504-23b120aa9dfb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:49.353895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 615/1206] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:27:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:27:49.362754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130371-79da-4667-8f48-e353ff81751b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:49.363606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130371-79da-4667-8f48-e353ff81751b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:49.363606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6130371-79da-4667-8f48-e353ff81751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:49.389351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a6130371-79da-4667-8f48-e353ff81751b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:27:49.390633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a6130371-79da-4667-8f48-e353ff81751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:27:49.482399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 592/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:27:49.512302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901fdf7-7482-41a1-b504-23b120aa9dfb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:49.643487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901fdf7-7482-41a1-b504-23b120aa9dfb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:49.684807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:49.685441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:49.685744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:49.685995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:49.698578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:27:49.703661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:49.707836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:49.709424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 616/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:49.714160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130371-79da-4667-8f48-e353ff81751b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:49.770918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:49.853321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6130371-79da-4667-8f48-e353ff81751b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:49.897601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:49.898311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:49.898759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:49.899095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:49.900051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:49.900423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:49.902124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:49.912372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 593/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:49.918686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:49.985176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:50.050927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07469a5-83fe-4ac1-aca2-715e26cf62b4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:50.093260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:50.094258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:50.094457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:50.094727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:50.111682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:50.113104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:50.127642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:50.128732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:50.129792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:50.129792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:50.129792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:50.129792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 617/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:27:50.135126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:50.259373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:50.262583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfc4ac-137b-4933-8b76-3e92ca6eb6cc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:50.310003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:50.310718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:50.311030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:50.311470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:50.312225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:50.312586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:50.314369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:50.330505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 594/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:50.336614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:50.461594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655378f-442d-4680-80a3-725dc4df31d6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:50.463311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:50.503567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:50.504195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:50.504464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:50.504727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:50.514580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:50.516303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:27:50.531198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:50.532826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:50.534125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 618/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:50.541234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:50.671399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb163031-25a1-401c-ad18-0d8ee28435dc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:50.711286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:50.712010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:50.712246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:50.712545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:50.713398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:50.713748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:50.715361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:50.743047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 595/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:27:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:50.745146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:50.879688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10f0b2-5378-44d4-888f-909a5358ec78 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:50.922032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:50.923032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:50.923530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:50.924142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:50.966094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:51.013360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:51.014811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:51.150169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 619/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:27:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 20:27:51.157220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:51.180827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:51.284595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cfde0-221a-45e5-8eb6-378aa7c0d757 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:51.333392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:51.334122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:51.334401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:51.335018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:51.348887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:51.351260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:51.370453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:51.376957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:51.378208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:51.378208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:51.378208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:51.378208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 596/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:51.379736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:51.450716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:51.496074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebd5c-8aaf-4984-9a82-5209944baca8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:51.538467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:51.538971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:51.539292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:51.539616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:51.540319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:51.540664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:51.542194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:51.555506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 620/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:51.562015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:51.643705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:51.683001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166931b3-fe0b-4f8e-85b2-068644eec165 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:51.727437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:51.728250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:51.728600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:51.728893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:51.736688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:51.738216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:27:51.750735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:51.751852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:27:51.752833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:51.758811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 597/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:51.758991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:51.883488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d55448-bb14-4901-a4cf-529402333c15 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:51.910313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:51.924319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:51.925007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:51.925323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:51.925624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:51.926411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:51.926786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:51.928381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb08313-ec16-4d84-aef8-7b740ca516e6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:51.942321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 621/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:27:51.949918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:52.074758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb17a7-6252-448b-a1a8-dbae867a99f1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:52.110664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:52.117570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:52.118210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:52.118484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:52.118749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:52.119507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=83fd7f4118514807bc58c1e28523cdcf) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:52.119792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:52.121243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fcc716-ceea-4834-a71e-a1be5d376163 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:52.135378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 598/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:27:51 2022] GET /identity/v3/role_assignments?user.id=83fd7f4118514807bc58c1e28523cdcf&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:54.309420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd786d-6081-4384-ba74-dd3c3531242f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:54.309953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd786d-6081-4384-ba74-dd3c3531242f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:54.310039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd786d-6081-4384-ba74-dd3c3531242f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:54.311659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 622/1220] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:27:54.316977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:54.317409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:54.317522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:54.343604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:27:54.345524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:27:54.429233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 599/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:27:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:27:54.454203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd786d-6081-4384-ba74-dd3c3531242f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:54.564005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd786d-6081-4384-ba74-dd3c3531242f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:54.611652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:54.612283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:54.612558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:54.612973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:54.627155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:27:54.632999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:54.634940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:54.636478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:54.639737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 623/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:54.641051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:54.755149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3575524-27d7-492a-abe9-b35b4d8252b5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:54.785293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:54.797189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:54.797801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:54.798079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:54.798348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:54.799011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] RBAC: Adding query filter params (name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:54.799365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:54.800719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:54.809620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 600/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:27:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:54.815658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:54.863542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:54.932655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34beedaa-69ea-45db-921a-054532deafcb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:54.978894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:54.979718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:54.980157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:54.980454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:54.993667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:54.995266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:55.011887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:55.013012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:55.013911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:55.013911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:55.013911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:55.013911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 624/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:27:55.019259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.128931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffba7e9-cf67-4a56-bf8d-71267f4035de None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:55.168599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:55.169378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:55.169771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:55.170046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:55.170694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:55.171035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:55.172487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.188346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 601/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:55.195154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.310587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:55.318408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed4ad2-a137-4c80-9c98-5be9f1bd9897 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:55.359029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:55.359762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:55.360070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:55.360357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:55.369303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:55.370983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:27:55.383745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:55.384793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:55.385734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 625/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:55.390920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.442287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:55.507261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc706039-fd1a-4db6-8cdf-200cabcb4bdb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:55.545098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:55.545739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:55.546014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:55.546339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:55.547357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:55.547664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:55.549275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.570464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 602/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:27:55.576324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.694540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82996dae-ed37-496c-81a5-48045e923d0f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:55.735622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:55.736474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:55.736896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:55.737176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:55.750300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:55.751950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:55.767663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:55.769126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:55.770222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:55.770222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:55.770222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:55.770222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 626/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:55.776118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.899812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6cc1d-dbd6-43ff-a0b5-b42e63fa4e03 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:55.902877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:55.941199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:55.941801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:55.942083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:55.942355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:55.943607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:55.943975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:55.945626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:55.958305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 603/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:55.964777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:55.975126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:56.081336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2ad3b-c11b-49e4-8a3f-3f004ea0dc7f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:56.120345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:56.121100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:56.121415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:56.121809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:56.129346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:56.131592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:27:56.143825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:56.145334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:27:56.146237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:27:56.148067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 627/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:56.154783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:56.265522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec7f54-826e-4a4a-9a70-2bf10cc67617 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:56.307114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:56.307847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:56.308097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:56.308390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:56.309130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:56.309463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:56.311032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f472ce-eb42-43c4-9da2-ed2197f6dba0 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:56.324185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 604/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:27:56.330815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:56.404598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:56.444759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b81f21-ed68-4bc4-bc57-c2437276e28f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:56.483918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:56.484677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:56.485000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:56.485330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/83fd7f4118514807bc58c1e28523cdcf/roles/cbb4230873f8412fa9115ed8f7761205` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:56.502362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=83fd7f4118514807bc58c1e28523cdcf, role_id=cbb4230873f8412fa9115ed8f7761205)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:56.503912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90dea7-8cd9-4109-b280-cc2f98637f5d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:56.517937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 628/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:27:56 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/83fd7f4118514807bc58c1e28523cdcf/roles/cbb4230873f8412fa9115ed8f7761205 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:27:58.835608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b689eb-5678-440e-94a7-99738ac79f5e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:58.836154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b689eb-5678-440e-94a7-99738ac79f5e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:58.836154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b689eb-5678-440e-94a7-99738ac79f5e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:58.837681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 605/1233] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:27:58.843511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:58.843962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:58.844121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:58.865700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:27:58.867028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:27:58.948076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 629/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:27:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:27:58.975484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b689eb-5678-440e-94a7-99738ac79f5e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:59.002530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:59.091308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b689eb-5678-440e-94a7-99738ac79f5e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:59.133598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:59.134157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:59.134436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:59.134701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:59.147720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:27:59.152364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:59.153449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:59.154329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 606/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 20:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:59.160915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:59.219015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:59.278293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe2c6-6687-4d45-8c96-dcd9e1f9bf63 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:59.321095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:59.321887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:59.322173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:59.322461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:59.323421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:59.323843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:59.325515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:59.338070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 630/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 20:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:59.344358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:59.447386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:59.465289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887622a-abc9-4028-ac5a-cb72a3e5a918 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:59.500058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:59.500677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:59.500951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:59.501215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:59.513070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:59.514941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:27:59.530196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:59.531356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:27:59.532401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:27:59.532401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:27:59.532401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:59.532401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 607/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:27:59.537615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:59.653909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec1833-b6c3-48ba-9ae6-56455e6c756e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:59.664218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:59.693375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:59.694063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:59.694360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:59.694635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:59.695446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:27:59.695805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:59.697363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:59.711223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 631/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:27:59.717316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:27:59.828299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349326b-a533-4a3f-8960-7b9b99aaa1a7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:27:59.865587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:27:59.866260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:27:59.866473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:27:59.866744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:27:59.870676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:27:59.877328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:27:59.879036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:27:59.891308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:27:59.892468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:27:59.893768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 608/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:27:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:27:59.899574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:00.010845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60a63b-c158-4f5b-bae5-908b0c0c0a8e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:00.048692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:00.049297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:00.049681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:00.049934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:00.050632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:00.050928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:00.052509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:00.070323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 632/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:27:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:00.076218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:00.181336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55dd23-a05a-46c0-bfc6-92be1fe8c7c1 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:00.225286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:00.225890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:00.226169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:00.226452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:00.301388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:00.308939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:00.310404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:00.425548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 609/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:28:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:28:00.431852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:00.462017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:00.538292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bfe37-debd-4d56-9dca-1261516d8751 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:00.573458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:00.574063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:00.574337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:00.574603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:00.586664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:00.588136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:00.603811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:00.604970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:00.610823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:00.610823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:00.610823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:00.610823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 633/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:28:00.611098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:00.716592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:00.722949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d7ea2-3cd7-454c-9fdf-b319aeabcd2c None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:00.758162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:00.758766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:00.759045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:00.759354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:00.760001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:00.760290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:00.761676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:00.775337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 610/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:00.780875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:00.869262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:00.900335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bc056-1d42-4139-8676-5f28e05b4d41 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:00.936858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:00.937482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:00.937759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:00.938029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:00.945607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:00.947282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:28:00.960691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:00.961686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:00.962564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 634/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:00.967881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:01.074394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21fd65-c024-4ccb-b7c9-7f554d3b06a7 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:01.108650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:01.109247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:01.109525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:01.109796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:01.110482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:01.110785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:01.112248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d110e2-f3d9-4b35-a9ac-699472386f6a None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:01.131343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 611/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:01.133186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:01.257481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcae8b6-5310-44cf-ba2e-5dc7a0c01b70 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:01.299513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:01.300150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:01.300571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:01.300981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:01.301827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] RBAC: Adding query filter params (role.id=cbb4230873f8412fa9115ed8f7761205, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=83fd7f4118514807bc58c1e28523cdcf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:01.302219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:01.304905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65e19-25cd-46ed-938e-9994ff9da641 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:01.312319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 635/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:28:01 2022] GET /identity/v3/role_assignments?user.id=83fd7f4118514807bc58c1e28523cdcf&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=cbb4230873f8412fa9115ed8f7761205 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:03.531373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd9c-05c5-44c1-959d-347622e80732 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:03.531941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd9c-05c5-44c1-959d-347622e80732 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:03.532106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bfd9c-05c5-44c1-959d-347622e80732 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:03.533608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 612/1247] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:03.539570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:03.540101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:03.540249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:03.547175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:03.560453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:03.561745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:03.639396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 636/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 20:28:03.666245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bfd9c-05c5-44c1-959d-347622e80732 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:03.686124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:03.777756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bfd9c-05c5-44c1-959d-347622e80732 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:03.812328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:03.812864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:03.813225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:03.813487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:03.825066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:28:03.829840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:03.831057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:03.832344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 613/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:03.837881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:03.948237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256a75d-1b83-4307-a3a4-881e307524ed None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:03.980893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:03.986636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:03.987273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:03.987543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:03.987808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:03.988459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:03.988751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:03.990801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:03.999922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 637/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:04.005792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:04.092016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:04.116811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf7fd9-442e-444d-9b9b-0305dd3195f8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:04.153923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:04.154546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:04.154823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:04.155091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:04.169240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:04.171157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:04.190754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:04.191974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:04.192887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:04.192887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:04.192887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:04.192887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 614/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:28:04.197824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:04.322331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6ba89-4a70-4407-b572-ae3cdbea3afb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:04.366367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:04.366884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:04.367162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:04.367460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:04.368096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:04.368400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:04.369760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:04.383229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 638/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:28:04.389829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:04.511030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25459ba8-4a76-4e51-96db-5529d6bd7bd8 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:04.544769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:04.554788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:04.555462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:04.555740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:04.556314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:04.567015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:04.569861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:28:04.588111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:04.589273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:04.590439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 615/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:04.597554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:04.661356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:04.712517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ddf-e91a-4bb5-a4a8-0333939525a1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:04.748844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:04.749577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:04.749890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:04.750230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:04.751064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:04.751391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:04.752829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:04.776176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 639/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:28:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:04.781795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:04.886856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e26b1-d15d-4c9b-b838-a385c1fc823b None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:04.925150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:04.925745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:04.926060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:04.926323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:04.984522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:04.998448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.000942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.104350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 616/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:28:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:28:05.110026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:05.219823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bedd27-ae91-47f0-9a7f-f247cfbf6496 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:05.233783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:05.255468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:05.256140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:05.256430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:05.256692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:05.267605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.268999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:05.284005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:05.285601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:05.287715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:05.287715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:05.287715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:05.287715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 640/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:05.294109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:05.402889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:05.416800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efba12-184b-42c3-96cb-9f70af4f6eb4 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:05.454060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:05.454938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:05.455215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:05.455511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:05.456161 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:05.456458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.457862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.473379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 617/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:05.479177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:05.588173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d545ef-706a-4bb8-84e7-86d76b02fefb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:05.624005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:05.624675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:05.624890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:05.625156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:05.633176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.634639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:28:05.647321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:05.648294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:05.649169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 641/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:05.654496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:05.758041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3185b8-4bbf-4a24-adc7-0d87f46c1d44 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:05.792734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:05.793337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:05.793611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:05.793878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:05.794570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:05.794870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.796354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b239a8-266b-4348-96c1-d3fa908e7590 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.815176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 618/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:05.816425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:05.843996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:05.920825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c98df-cc6f-4f35-83c8-ec8af04cdf32 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:05.956815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:05.957419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:05.957691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:05.957958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:05.958707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=83fd7f4118514807bc58c1e28523cdcf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:05.959008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:05.960723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6f533-c1cf-49e2-8224-1cd596badf47 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:05.966220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 642/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:28:05 2022] GET /identity/v3/role_assignments?user.id=83fd7f4118514807bc58c1e28523cdcf&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:28:07.943949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2db97-0d1e-4534-bffb-fd613bcf0f4b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:07.944447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2db97-0d1e-4534-bffb-fd613bcf0f4b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:07.944447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2db97-0d1e-4534-bffb-fd613bcf0f4b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:07.945716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 619/1261] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:07.950617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:07.951009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:07.951149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:07.969530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:07.970688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:08.033877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 643/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:08.055495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2db97-0d1e-4534-bffb-fd613bcf0f4b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.065988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.152402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2db97-0d1e-4534-bffb-fd613bcf0f4b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.184179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.184799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.185053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.185315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.195794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:28:08.200311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:08.201411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:08.202283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 620/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:08.207266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.225354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.306507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5d15-c8ef-446b-992b-eaa3e39ae565 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.346944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.347659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.348001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.348272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.349011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:08.349840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:08.351607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:08.361023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 644/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:08.368147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.432870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.465110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a72f6-d6fd-42a6-a9ad-e38f539727cf None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.497778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.498379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.498649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.498911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.508422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:08.509859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:08.523540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:08.524640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:08.525747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:08.525747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:08.525747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:08.525747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 621/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 20:28:08.530383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.608231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.627265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626551-8243-4b39-ab33-bc693646aa91 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.658653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.659270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.659539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.659803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.660428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:08.660721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:08.662598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:08.673737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 645/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:08.679889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.776093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b051f7-70e1-406b-86cb-a4f96d85a526 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.795000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.808608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.809214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.809488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.809754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.816836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:08.818233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:28:08.828805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:08.829885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:08.831028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 622/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:08.836273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:08.933851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ca43b-f080-4a5d-955e-0cbcbb088883 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:08.966310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:08.966897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:08.967168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:08.967462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:08.968165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:08.968462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:08.969864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:08.978633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:08.986902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 646/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:28:08.992518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:09.087889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af29e3-9830-4307-ae44-4f0bc84140cc None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:09.119974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:09.120580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:09.120856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:09.121124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:09.132373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:09.133805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:09.147783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:09.148844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:09.149894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:09.149894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:09.149894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:09.149894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 623/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:09.154312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:09.250050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723915-d4e9-4bda-970b-2c133b5e6878 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:09.282684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:09.283291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:09.283574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:09.283843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:09.284476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:09.284777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:09.286126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:09.297697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 647/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:09.304943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:09.342912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:09.409399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443e1d3-e7a0-42ee-a6e2-c7b3a7db0ae3 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:09.442094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:09.442704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:09.443017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:09.443314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:09.449739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:09.451158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:28:09.462760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:09.463785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:09.464702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 624/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:09.469791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:09.526468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:09.566416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c67eb-1ea2-4dff-bb36-ba801b6067b2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:09.599120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:09.600313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:09.600498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:09.600764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:09.601444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:09.601742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:09.603159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5b81e-a550-46b6-8466-3f68dbedafe6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:09.614856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 648/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:09.620866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:09.708991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:09.718008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85087-857f-44cc-84a7-65a53744aa67 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:09.750191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:09.750823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:09.751100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:09.751399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] PATH_INFO: `/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/83fd7f4118514807bc58c1e28523cdcf/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:09.753244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1a1635b9b19476b9ba5686201da709f, user_id=83fd7f4118514807bc58c1e28523cdcf, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:09.754658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff732a0-4649-4630-a082-727bcbc9c58d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:09.767298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 625/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 20:28:09 2022] PUT /identity/v3/projects/b1a1635b9b19476b9ba5686201da709f/users/83fd7f4118514807bc58c1e28523cdcf/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:28:11.754182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82bb7-53a7-4a45-8837-cdd3d8a28b09 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:11.754701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82bb7-53a7-4a45-8837-cdd3d8a28b09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:11.754823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb82bb7-53a7-4a45-8837-cdd3d8a28b09 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:11.756517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 649/1274] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:11.761706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:11.762122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:11.762246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:11.780560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:11.781736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:11.844710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 626/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:11.867788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82bb7-53a7-4a45-8837-cdd3d8a28b09 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:11.965635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb82bb7-53a7-4a45-8837-cdd3d8a28b09 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:11.982429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:11.998794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:11.999429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:11.999703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:11.999967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.009651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 20:28:12.014197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:12.015320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:12.016163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 650/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 20:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:12.021676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.099649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:12.118004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4d6d-b31c-4e51-89d8-e4caf9fc796a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.150032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65704-1365-4263-8995-47282be47ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.150616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65704-1365-4263-8995-47282be47ddb None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.150891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65704-1365-4263-8995-47282be47ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.151155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b65704-1365-4263-8995-47282be47ddb None admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.151834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b65704-1365-4263-8995-47282be47ddb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:12.152132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b65704-1365-4263-8995-47282be47ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:12.153473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b65704-1365-4263-8995-47282be47ddb None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:12.161024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 627/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:12.167215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.263564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e38f-a9d5-4b6b-bc95-180fc78b2ae7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.295553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.296248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.296528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.296936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.308315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:12.309753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:12.326009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:12.327581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:12.328488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:12.328488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:12.328488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:12.328488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 651/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:12.333289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65704-1365-4263-8995-47282be47ddb None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.440279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b65704-1365-4263-8995-47282be47ddb None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.472606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.473194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.473469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.473737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.474993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:12.475317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:12.476662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:12.488329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 628/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:12.493949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.524048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:12.590996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab82b9-7667-407d-9c0b-b627b542b362 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.623344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.623955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.624227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.624492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.631646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:12.633066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 20:28:12.643646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:12.644707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:12.645840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 652/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:12.650985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.654649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:12.747297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc8f09-564a-4652-a723-863fb2781e29 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.779731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.780318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.780594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.780861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:12.781570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:12.781871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:12.783329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:12.800037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 629/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:12.805587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:12.893622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:12.903785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc5ecd-17a5-4b7d-8dc4-95634e6437bd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:12.936374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:12.936955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:12.937231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:12.937497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.002714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.004112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.088969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:13.099622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 653/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 20:28:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 20:28:13.105235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:13.166245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:13.204337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a15fa-0b14-4abd-aedd-bdd4cefee026 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:13.237272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:13.237883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:13.238160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:13.238428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.248078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.249496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 20:28:13.263477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:13.264576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 20:28:13.265705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 20:28:13.265705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 20:28:13.265705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:13.265705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 630/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:13.270153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:13.372354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738b17-9ef8-419c-b661-b105919d7b8e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:13.405176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:13.405772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:13.406047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:13.406314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.406945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:13.407276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.408617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.420010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 654/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 20:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:13.425581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:13.524152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f57e03-fdc3-419c-83bf-9a2edf7fde66 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:13.537526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:13.557285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:13.557895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:13.558169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:13.558435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.564709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.566157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 20:28:13.577339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:13.578267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: ERROR keystone.server.flask.application Aug 06 20:28:13.579285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 631/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 20:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:13.584795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:13.633663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:13.685556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbe068-4e51-40c5-84b9-6d0973a74e23 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:13.717085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:13.717672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:13.717942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:13.718202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.718884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:13.719179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.720607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b874ef3-7dc5-40cf-b2e6-7d29a0136e8f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.732465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 655/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 20:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:13.738498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:13.834025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668396d6-dc8b-4e56-b430-4c42622f254d None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:13.866426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:13.867008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:13.867304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:13.867575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:13.868279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] RBAC: Adding query filter params (role.id=fc8cdbed278f4649be4a0ebce40b55ee, scope.project.id=b1a1635b9b19476b9ba5686201da709f, user.id=83fd7f4118514807bc58c1e28523cdcf) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:13.868607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:13.870020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23736f-18c6-4743-b40b-feb45a1d15ac None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:13.875545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 632/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 20:28:13 2022] GET /identity/v3/role_assignments?user.id=83fd7f4118514807bc58c1e28523cdcf&scope.project.id=b1a1635b9b19476b9ba5686201da709f&role.id=fc8cdbed278f4649be4a0ebce40b55ee => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:15.843536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64c52-de5c-4f2f-93e8-ce00e9640e1d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:15.844061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64c52-de5c-4f2f-93e8-ce00e9640e1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:15.844061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64c52-de5c-4f2f-93e8-ce00e9640e1d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:15.845378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 656/1288] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:15.850367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:15.850801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:15.850899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:15.868951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:15.870120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:15.899023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:15.934749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 633/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:15.956282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64c52-de5c-4f2f-93e8-ce00e9640e1d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:16.053834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64c52-de5c-4f2f-93e8-ce00e9640e1d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:16.063913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:16.086458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:16.087063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:16.087361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:16.087631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:16.088195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:16.089537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:16.097789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:16.099503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:16.100481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 657/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:28:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:16.105096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:16.197086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a0b2-b9ab-4241-8e3c-fcac7a62be0b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:16.229701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:16.230280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:16.230551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:16.230813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:16.231446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:16.231742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:16.233075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d37ec-7abc-492d-adfc-ec46f6ecc2c2 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:16.237594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 634/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 20:28:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:28:16.243031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:16.345308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c2bec-3585-4070-af10-26f500ea7592 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:16.380193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:16.380727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:16.381000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:16.381265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:16.381877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:16.382170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:16.383556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0acbc4-bd7c-4d73-a472-9b16290b069b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:16.387809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 658/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 20:28:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:18.464298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c123-8862-4f99-8543-b481d1fe1ad0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:18.464846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c123-8862-4f99-8543-b481d1fe1ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:18.464846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8c123-8862-4f99-8543-b481d1fe1ad0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:18.466145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 635/1293] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:18.471230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224eb-9d40-4bc4-b27c-b4c8311c6999 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:18.471679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224eb-9d40-4bc4-b27c-b4c8311c6999 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:18.471778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b224eb-9d40-4bc4-b27c-b4c8311c6999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:18.489257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-86b224eb-9d40-4bc4-b27c-b4c8311c6999 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:18.490909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-86b224eb-9d40-4bc4-b27c-b4c8311c6999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:18.519514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:18.555759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 659/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:18.577539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8c123-8862-4f99-8543-b481d1fe1ad0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:18.608153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:18.684412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8c123-8862-4f99-8543-b481d1fe1ad0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:18.716689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:18.717221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:18.717496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:18.717761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:18.718398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:18.719773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b14d-e5e0-4604-9bb9-61e4b19a82d8 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:18.734235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 636/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 20:28:18 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:28:20.694796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f580-6e9d-4bfc-bab0-58f913ae05bd None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:20.695402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f580-6e9d-4bfc-bab0-58f913ae05bd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:20.695402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f580-6e9d-4bfc-bab0-58f913ae05bd None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:20.696689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 660/1296] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:20.701713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:20.702098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:20.702257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:20.719890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:20.721052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:20.789800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 637/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:20.811698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f580-6e9d-4bfc-bab0-58f913ae05bd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:20.909361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f580-6e9d-4bfc-bab0-58f913ae05bd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:20.942371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:20.942998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:20.943364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:20.943649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:20.944212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:20.945559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:20.953875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:20.955011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:20.955901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 661/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:28:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:20.961048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:20.978964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:21.057462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4abb1-468c-41e7-b5af-ce762bd27939 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:21.089349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:21.089933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:21.090206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:21.090489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:21.091078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:21.091407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:21.092741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:21.097639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 638/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 20:28:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:21.103862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:21.134552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:21.199980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536244eb-da43-4d99-9a45-e76141c73c58 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:21.232454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:21.233023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:21.233298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:21.233561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:21.234238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] RBAC: Adding query filter params (interface=public, service_id=8c5256201e7b428996db422e81c8ae7f, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:21.234535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:21.235895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003295ea-715b-41bb-b5d5-2fd0698eb2d4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:21.240673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 662/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 20:28:21 2022] GET /identity/v3/endpoints?service_id=8c5256201e7b428996db422e81c8ae7f&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:28:21.246125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:21.334590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:21.355071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f86b-b1ec-433e-b5e7-97e0af29a215 None admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:21.390506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:21.391099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:21.391398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:21.391668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:21.392261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:21.393602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21079a-92a0-42c7-b3b6-868e65d417f5 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:21.400633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 639/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 20:28:21 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:28:23.354627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86d46-fd72-486e-8966-ad0b2809be56 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:23.355151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86d46-fd72-486e-8966-ad0b2809be56 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:23.355151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df86d46-fd72-486e-8966-ad0b2809be56 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:23.356511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 663/1302] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:28:23.361509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:23.361940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:23.362040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:23.381408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:28:23.382576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:28:23.446271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 640/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:28:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 20:28:23.468525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df86d46-fd72-486e-8966-ad0b2809be56 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:23.560355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:23.567049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df86d46-fd72-486e-8966-ad0b2809be56 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:23.600276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:23.600650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:23.600925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:23.601196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:23.601769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:23.603117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 06 20:28:23.611709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 20:28:23.612845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: ERROR keystone.server.flask.application Aug 06 20:28:23.613685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 664/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 20:28:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 20:28:23.619118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:23.691566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:23.716547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087806d-6b77-462f-afa4-5435ea7e4293 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:23.749368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:23.749962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:23.750239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:23.750506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] PATH_INFO: `/v3/services` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:23.751123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:28:23.751447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:23.752812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a3f6d-9a44-4c36-8cf1-56c37e293681 None admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:23.758228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 641/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 20:28:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:28:23.764241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:28:23.859129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f9a8-76c0-4bb2-9674-5f1a608af278 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:28:23.891473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:28:23.891998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:28:23.892267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:28:23.892533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:28:23.893165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:28:23.894492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a37e1-1be6-4c0d-8ab7-75480820d8a1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:28:23.914059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 665/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:28:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:28:33.754805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=30 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:28:33.909838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:26.694284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f513a8-2177-4660-b131-fa4442037938 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:26.694856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f513a8-2177-4660-b131-fa4442037938 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:26.694856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f513a8-2177-4660-b131-fa4442037938 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:26.701535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 642/1307] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:26.702612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73cc95-bbd0-407e-9194-5f61384f687e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:26.703091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73cc95-bbd0-407e-9194-5f61384f687e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:26.703335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73cc95-bbd0-407e-9194-5f61384f687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:26.789461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fe73cc95-bbd0-407e-9194-5f61384f687e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:26.790673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fe73cc95-bbd0-407e-9194-5f61384f687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:26.930177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 666/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:26.985068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:26.985360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:26.985635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:26.987233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 643/1309] 10.222.0.17 () {54 vars in 965 bytes} [Sat Aug 6 20:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:26.992931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42eff7-2095-40f7-93d8-9d3130d6fe6d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:26.993249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42eff7-2095-40f7-93d8-9d3130d6fe6d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:26.993528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42eff7-2095-40f7-93d8-9d3130d6fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:27.079058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-df42eff7-2095-40f7-93d8-9d3130d6fe6d None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:27.080295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-df42eff7-2095-40f7-93d8-9d3130d6fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:27.102767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:27.164454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 667/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Aug 6 20:29:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:27.173030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:27.174666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:27.316513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f85e-3733-49cd-aed0-dd994dfad24b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:27.394358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:27.394888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:27.395207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:27.395525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:27.397147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:27.463520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:27.530754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:27.532241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c37b4-99e5-471c-b675-0c9bfcb065c7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:27.555013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 644/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:29.900674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:29.901098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:29.901220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:29.902552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 668/1312] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:29.907657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547f016-0135-46df-8f0d-12972be1bdeb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:29.908053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547f016-0135-46df-8f0d-12972be1bdeb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:29.908215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547f016-0135-46df-8f0d-12972be1bdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:29.993848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c547f016-0135-46df-8f0d-12972be1bdeb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:29.995154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c547f016-0135-46df-8f0d-12972be1bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:30.098060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 645/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:30.136494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:30.138180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:30.246918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925476f9-a807-4181-9267-4bf0b82b9ed7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:30.322787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:30.325549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:30.326338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:30.326783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:30.327253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:30.328876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:30.439170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:30.440543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78080f46-298b-4451-b43c-ec0f90374643 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:30.460245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 669/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:32.768113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:32.768634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:32.768634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:32.769920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 646/1315] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:32.774883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba0e5-fe17-4f31-b814-8a8546baee9c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:32.775344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba0e5-fe17-4f31-b814-8a8546baee9c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:32.775450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ba0e5-fe17-4f31-b814-8a8546baee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:32.840034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7a1ba0e5-fe17-4f31-b814-8a8546baee9c None None] MFA Rules not processed for user `0f3a400d92614fb78543a24ca95ef1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:32.841225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7a1ba0e5-fe17-4f31-b814-8a8546baee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:32.891698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:32.935664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 670/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:32.975665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:32.977212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:32.986794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:33.077489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2994e6f-c838-4f95-a5a8-edca550e575f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:33.148141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:33.148732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:33.149004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:33.149265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:33.150829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:33.211477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:33.257280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:33.258692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd901f-1f9c-49bc-b831-d49e0f62ec01 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:33.276887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 647/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:35.811827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:35.812414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:35.812414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:35.813708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 671/1318] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:35.819068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983d675-921f-4d04-955e-ec649c5d197e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:35.819504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983d675-921f-4d04-955e-ec649c5d197e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:35.819649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983d675-921f-4d04-955e-ec649c5d197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:35.886114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9983d675-921f-4d04-955e-ec649c5d197e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:35.887272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9983d675-921f-4d04-955e-ec649c5d197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:35.981607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 648/1319] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:36.019653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:36.021671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:36.122385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb415-5b3e-4c35-b9ea-fcce53d039ea None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:36.200677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:36.201221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:36.201500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:36.201772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:36.203392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:36.211457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:36.312044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:36.313680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59499-c5f7-44d7-a987-ff709a7fb4d3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:36.333235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 672/1320] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:39.030136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:39.030641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:39.030641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:39.031959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 649/1321] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:39.037846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00814-b654-43db-9142-21dcfcae8010 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:39.038280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00814-b654-43db-9142-21dcfcae8010 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:39.038520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00814-b654-43db-9142-21dcfcae8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:39.108820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-57a00814-b654-43db-9142-21dcfcae8010 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:39.110119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-57a00814-b654-43db-9142-21dcfcae8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:39.173485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:39.218183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 673/1322] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:39.254887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:39.256469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:39.277404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:39.362910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6009fb-39ce-4818-8b21-4f4f0d85456e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:39.435584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:39.436184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:39.436518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:39.436791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:39.438380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:39.508557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:39.546386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:39.547883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf034e5-3bc6-40ac-96d2-d89210d076a1 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:39.566627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 650/1323] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:41.627711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:41.628215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:41.628307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:41.629949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 674/1324] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:41.635175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df20ae-7da3-4963-9405-d75c00ca7faa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:41.635594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df20ae-7da3-4963-9405-d75c00ca7faa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:41.635755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df20ae-7da3-4963-9405-d75c00ca7faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:41.699813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f5df20ae-7da3-4963-9405-d75c00ca7faa None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:41.701007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f5df20ae-7da3-4963-9405-d75c00ca7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:41.795112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 651/1325] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:41.830868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:41.833004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:41.936766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ee8b-b333-46db-abad-c59431695c7f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:42.014018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:42.014622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:42.014897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:42.015164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:42.016867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:42.037716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:42.131378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:42.132577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a18688-eb05-4592-a9cc-31598b580196 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:42.151396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 675/1326] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:44.195568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:44.196139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:44.196139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:44.197429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 652/1327] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:44.202466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c434-00fd-4ece-b4fa-459218712445 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:44.202870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c434-00fd-4ece-b4fa-459218712445 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:44.203125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662c434-00fd-4ece-b4fa-459218712445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:44.271700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4662c434-00fd-4ece-b4fa-459218712445 None None] MFA Rules not processed for user `0f3a400d92614fb78543a24ca95ef1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:44.272834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4662c434-00fd-4ece-b4fa-459218712445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:44.345922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:44.381702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 676/1328] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:44.419901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:44.421491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:44.451803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:44.524288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6088cd-98ba-4bea-9f35-f82900d3e069 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:44.600524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:44.600987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:44.601260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:44.601517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:44.603123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:44.679367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:44.711628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:44.713345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed316a-4ae4-42ee-84b8-576b705479c9 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:44.730724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 653/1329] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:29:46.982632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:46.983232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:46.983232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:46.984534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 677/1330] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:46.990260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ea5-4bd1-4a34-b8da-1146db5d2d5e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:46.990665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ea5-4bd1-4a34-b8da-1146db5d2d5e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:46.990811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ea5-4bd1-4a34-b8da-1146db5d2d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:47.054837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6f1e3ea5-4bd1-4a34-b8da-1146db5d2d5e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:47.056053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6f1e3ea5-4bd1-4a34-b8da-1146db5d2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:47.149994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 654/1331] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:47.185516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:47.187037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:47.291317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfcb9e-de9f-4ebc-b1eb-96a18870d9e7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:47.364585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:47.365187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:47.365461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:47.365723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:47.367370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:47.393648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:47.474094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:47.475542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879c27c-6492-4666-9b9c-2e15bf4fd285 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:47.493280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 678/1332] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:49.511820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff76d9-76c6-44cc-9ad8-6cb489a9dc5b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:49.512388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff76d9-76c6-44cc-9ad8-6cb489a9dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:49.512388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff76d9-76c6-44cc-9ad8-6cb489a9dc5b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:49.513709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 655/1333] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:49.518854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c713a5-ece1-47da-b7dc-7486ba0b044f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:49.519298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c713a5-ece1-47da-b7dc-7486ba0b044f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:49.519404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c713a5-ece1-47da-b7dc-7486ba0b044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:49.584536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-43c713a5-ece1-47da-b7dc-7486ba0b044f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:49.585723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-43c713a5-ece1-47da-b7dc-7486ba0b044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:49.664023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:49.686512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 679/1334] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:49.742757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:49.743040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:49.743340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:49.744672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 656/1335] 10.222.0.17 () {54 vars in 965 bytes} [Sat Aug 6 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:49.750492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03a48-c7e8-431d-bafe-e639ed6153e5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:49.750774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03a48-c7e8-431d-bafe-e639ed6153e5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:49.751040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba03a48-c7e8-431d-bafe-e639ed6153e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:49.825656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2ba03a48-c7e8-431d-bafe-e639ed6153e5 None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:49.826848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2ba03a48-c7e8-431d-bafe-e639ed6153e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:49.901739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 680/1336] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Aug 6 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:49.910778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:49.912352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:49.952077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:50.015575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3006922-92fc-4788-9c80-c39b3e564698 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:50.086445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:50.086974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:50.087282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:50.087555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:50.089422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:50.169958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:50.196309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:50.197746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599c511-8080-452d-8efa-110c9534b6fd service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:50.215414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 657/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:29:53.047136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404424-3287-4324-901f-51c69d86428e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:53.047700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404424-3287-4324-901f-51c69d86428e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:53.047700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa404424-3287-4324-901f-51c69d86428e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:53.048950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 681/1338] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:53.054712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4332e-58b7-4e3d-b087-704fdd07b713 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:53.055173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4332e-58b7-4e3d-b087-704fdd07b713 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:53.055289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4332e-58b7-4e3d-b087-704fdd07b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:53.119657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-06a4332e-58b7-4e3d-b087-704fdd07b713 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:53.120849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-06a4332e-58b7-4e3d-b087-704fdd07b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:53.217907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 658/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:53.253880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404424-3287-4324-901f-51c69d86428e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:53.255449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aa404424-3287-4324-901f-51c69d86428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:53.339206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:53.368210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa404424-3287-4324-901f-51c69d86428e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:53.439284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:53.439887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:53.440163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:53.440432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:53.442054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:53.547675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:53.549095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f6c2e-1bbf-4de7-b418-6b9c36b2c1fc service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:53.566498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 682/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:29:57.637426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:57.637950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:57.638063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:57.639478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 659/1341] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:29:57.644646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e172ed-5441-4936-a56f-fc2967577aa2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:57.645091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e172ed-5441-4936-a56f-fc2967577aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:57.645229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e172ed-5441-4936-a56f-fc2967577aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:57.650836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:57.711813 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-48e172ed-5441-4936-a56f-fc2967577aa2 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:29:57.713267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-48e172ed-5441-4936-a56f-fc2967577aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:57.814435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 683/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:29:57.853674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:29:57.855225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:57.903936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:57.958427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346d1f6-02e3-42d4-b175-1f1d49652fab None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:29:58.031563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:29:58.032164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:29:58.032443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:29:58.032715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:29:58.034320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:29:58.126061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:29:58.142818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:29:58.144281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a48abc-1cc5-4af7-bdf4-72dab0c5d7bf service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:29:58.162391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 660/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:30:00.826630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:00.827206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:00.827206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:00.828649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 684/1344] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:00.834840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1d07-dbac-40f5-9667-1b1a4c91b029 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:00.835468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1d07-dbac-40f5-9667-1b1a4c91b029 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:00.835468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1d07-dbac-40f5-9667-1b1a4c91b029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:00.906730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3abe1d07-dbac-40f5-9667-1b1a4c91b029 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:00.907983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3abe1d07-dbac-40f5-9667-1b1a4c91b029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:01.005179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 661/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:01.042198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:01.043824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:01.132899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:01.151460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690b57f-e901-4f3a-bc55-afeb81f6ca98 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:01.226335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:01.226937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:01.227210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:01.227508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:01.229113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:01.344827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:01.346262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6455db-ff2e-434b-8c3d-d730c2d4864d service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:01.364360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 685/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:05.343741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:05.344264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:05.344407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:05.345880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 662/1347] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:05.351192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3d6f-8105-497b-b224-207e6507804f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:05.351662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3d6f-8105-497b-b224-207e6507804f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:05.351742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f3d6f-8105-497b-b224-207e6507804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:05.367391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:05.420273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0e9f3d6f-8105-497b-b224-207e6507804f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:05.421475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e9f3d6f-8105-497b-b224-207e6507804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:05.518056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 686/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:05.556215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:05.557969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:05.622167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:05.680296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e9ae7-2736-4596-8334-008a5520cc6e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:05.763698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:05.764304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:05.764585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:05.764842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:05.766440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:05.882990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:05.887082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:05.888760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e6929-4726-4fd8-b6a9-a29f80036e62 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:05.907585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 663/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:10.851070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a8c7-70ab-4e74-845d-5db8acb592a3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:10.851540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a8c7-70ab-4e74-845d-5db8acb592a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:10.851786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6a8c7-70ab-4e74-845d-5db8acb592a3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:10.853523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 687/1350] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:10.858614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d32-48e2-4288-b04f-8b36f0bf7223 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:10.859014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d32-48e2-4288-b04f-8b36f0bf7223 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:10.859190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b007d32-48e2-4288-b04f-8b36f0bf7223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:10.954697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7b007d32-48e2-4288-b04f-8b36f0bf7223 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:10.955973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7b007d32-48e2-4288-b04f-8b36f0bf7223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:11.115639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 664/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:30:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:30:15.516264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=59 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:15.992331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f04b4-3806-437c-8471-363e8f373cf5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:15.992889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f04b4-3806-437c-8471-363e8f373cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:15.993315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f04b4-3806-437c-8471-363e8f373cf5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:15.994834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 688/1352] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:15.999977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b87e6-b0fa-4f83-b262-a19b0676c8c5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:16.000445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b87e6-b0fa-4f83-b262-a19b0676c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:16.000558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b87e6-b0fa-4f83-b262-a19b0676c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:16.058665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:16.084431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-600b87e6-b0fa-4f83-b262-a19b0676c8c5 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:16.085625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-600b87e6-b0fa-4f83-b262-a19b0676c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:16.203944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 665/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:30:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:17.392880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83ac6-d572-4756-a2cb-da54ca2df61b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:17.393470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83ac6-d572-4756-a2cb-da54ca2df61b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:17.393470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d83ac6-d572-4756-a2cb-da54ca2df61b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:17.395533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 689/1354] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:17.402314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c7b6-805f-432f-993c-db5939e26264 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:17.402871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c7b6-805f-432f-993c-db5939e26264 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:17.402871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c7b6-805f-432f-993c-db5939e26264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:17.489895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cf96c7b6-805f-432f-993c-db5939e26264 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:17.491581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cf96c7b6-805f-432f-993c-db5939e26264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:17.537452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:17.610129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 666/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:20.720418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45ad4-f36e-4f41-9921-95b35595564f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:20.720944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45ad4-f36e-4f41-9921-95b35595564f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:20.720944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45ad4-f36e-4f41-9921-95b35595564f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:20.722808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 690/1356] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:20.727834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499c8b-ec37-4f14-90d1-6820ebf188b1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:20.728289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499c8b-ec37-4f14-90d1-6820ebf188b1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:20.728549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f499c8b-ec37-4f14-90d1-6820ebf188b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:20.820806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8f499c8b-ec37-4f14-90d1-6820ebf188b1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:20.822169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f499c8b-ec37-4f14-90d1-6820ebf188b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:20.926250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 667/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:20.978451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:20.979012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:20.979722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:20.981498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 691/1358] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 20:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:20.990167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015da35-0bf9-4df8-84ab-91fd460bfdae None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:20.990705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015da35-0bf9-4df8-84ab-91fd460bfdae None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:20.991197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015da35-0bf9-4df8-84ab-91fd460bfdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:21.013208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:21.079411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7015da35-0bf9-4df8-84ab-91fd460bfdae None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:21.080589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7015da35-0bf9-4df8-84ab-91fd460bfdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:21.206693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 668/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:21.214657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:21.216186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:21.385222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85185f5-bf93-4995-92c2-7c59f35f879e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:21.467164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:21.512623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:21.513259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:21.513536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:21.513809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:21.515452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:21.618220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:21.619950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97943c-73b6-4ac1-a731-c619f50fcfd7 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:21.642785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 692/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:23.955676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:23.956195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:23.956195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:23.959283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 669/1361] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:23.962773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d1b4-1934-4d36-a17b-c5b8cbf34d51 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:23.963492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d1b4-1934-4d36-a17b-c5b8cbf34d51 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:23.963671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6d1b4-1934-4d36-a17b-c5b8cbf34d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:24.043560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-00f6d1b4-1934-4d36-a17b-c5b8cbf34d51 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:24.044766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-00f6d1b4-1934-4d36-a17b-c5b8cbf34d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:24.099954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.172163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 693/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:24.216691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:24.218280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:24.287525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.411346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5204e5-7383-40fe-a643-0479d29116be None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:24.532494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:24.533522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:24.533996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:24.534451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:24.537100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:24.562008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:24.640513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:24.642036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c92545-5ea9-4a91-9076-4e2de027e5a5 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:24.662193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 670/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:27.009831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5479-6600-4271-8b79-8e4c798ff9a8 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:27.010734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5479-6600-4271-8b79-8e4c798ff9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:27.011011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f5479-6600-4271-8b79-8e4c798ff9a8 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:27.012413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 694/1364] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:27.017900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18e8-6693-410f-a179-20eb0029125c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:27.018352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18e8-6693-410f-a179-20eb0029125c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:27.018521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18e8-6693-410f-a179-20eb0029125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:27.095104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a70a18e8-6693-410f-a179-20eb0029125c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:27.096634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a70a18e8-6693-410f-a179-20eb0029125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:27.198287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:27.201103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 671/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:27.250724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:27.251238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:27.251537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:27.253798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 695/1366] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 20:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:27.259731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac616f-e092-4b3d-9785-b042a5d6a62f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:27.260148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac616f-e092-4b3d-9785-b042a5d6a62f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:27.260527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac616f-e092-4b3d-9785-b042a5d6a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:27.350970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-05ac616f-e092-4b3d-9785-b042a5d6a62f None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:27.352372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-05ac616f-e092-4b3d-9785-b042a5d6a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:27.477628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 672/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:27.485351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:27.486867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:27.651071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84531997-9dd7-4627-82eb-f9ab2dc1a221 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:27.675957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:27.780024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:27.780777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:27.781062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:27.781337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:27.782947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:27.882622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:27.884361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c84e95-c62f-4ed9-a3cb-8bb6444cf56a service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:27.905391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 696/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:28.824344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32090-a20b-46bf-8a77-cc324865a2eb None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:28.824909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32090-a20b-46bf-8a77-cc324865a2eb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:28.824909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae32090-a20b-46bf-8a77-cc324865a2eb None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:28.826385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 673/1369] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:28.831973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c46f-83b6-4794-ab4a-d92ab685a964 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:28.832392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c46f-83b6-4794-ab4a-d92ab685a964 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:28.832501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0c46f-83b6-4794-ab4a-d92ab685a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:28.865565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:28.901602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7be0c46f-83b6-4794-ab4a-d92ab685a964 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:28.902785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7be0c46f-83b6-4794-ab4a-d92ab685a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:29.023680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 697/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:29.397659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:29.398223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:29.398698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:29.400553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 674/1371] 10.222.0.17 () {54 vars in 964 bytes} [Sat Aug 6 20:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:29.405771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77192-c322-427f-bffe-4eef98be3dbd None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:29.406061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77192-c322-427f-bffe-4eef98be3dbd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:29.406339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff77192-c322-427f-bffe-4eef98be3dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:29.506925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eff77192-c322-427f-bffe-4eef98be3dbd None None] MFA Rules not processed for user `29f9cc8a29c4481491d319883cab7056`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:29.508402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eff77192-c322-427f-bffe-4eef98be3dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:29.565764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:29.617415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 698/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Aug 6 20:30:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:29.624858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:29.626742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:29.694445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:29.760576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221478b2-c95d-4a31-a014-38ee6571cb36 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:29.870512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:29.872626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:29.873154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:29.873873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:29.875834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:30.029795 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:30.056648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:30.059073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:30.070410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05930-ec6a-424e-91f2-bb7f9ac6a9ac None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:30.070890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05930-ec6a-424e-91f2-bb7f9ac6a9ac None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:30.071071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05930-ec6a-424e-91f2-bb7f9ac6a9ac None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:30.076443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 699/1373] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:30:30.077579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca826c-2154-4cb7-9b5e-a4b5b9cb819d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:30.077862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca826c-2154-4cb7-9b5e-a4b5b9cb819d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:30.078138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca826c-2154-4cb7-9b5e-a4b5b9cb819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:30.099361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 675/1374] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:30.178344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9dca826c-2154-4cb7-9b5e-a4b5b9cb819d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:30.180858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9dca826c-2154-4cb7-9b5e-a4b5b9cb819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:30.410281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 700/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:30.463808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:30.463808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:30.595327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52538-db43-4ba0-9fdd-a5aeae8c0c3e service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:30.709728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:30.717957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:30.718643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:30.718993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:30.719424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:30.721251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:30.817835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:30.819446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b9da3-641f-4ab4-96df-3a383279767c service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:30.847398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 676/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:32.933061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:32.933567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:32.933567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:32.934849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 701/1377] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:32.940823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31163-8e6a-4f58-8994-32a69a570a18 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:32.941270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31163-8e6a-4f58-8994-32a69a570a18 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:32.941386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd31163-8e6a-4f58-8994-32a69a570a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:33.020668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-dcd31163-8e6a-4f58-8994-32a69a570a18 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:33.021938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dcd31163-8e6a-4f58-8994-32a69a570a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:33.083589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:33.126146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 677/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:33.175173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:33.176888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:33.246000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:33.397159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29954ae-58a0-416d-a104-80b33bea1110 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:33.517870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:33.518443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:33.518724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:33.518998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:33.520624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:33.533364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:33.645849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:33.647792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257386f1-6d2b-4d1e-8c3b-6b310aea8675 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:33.668790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 702/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:35.798344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:35.798862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:35.798862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:35.802811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 678/1380] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:35.806167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5a51-6049-45a6-97a6-f7635ff1b941 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:35.806621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5a51-6049-45a6-97a6-f7635ff1b941 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:35.806704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f5a51-6049-45a6-97a6-f7635ff1b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:35.880152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-081f5a51-6049-45a6-97a6-f7635ff1b941 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:35.882515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-081f5a51-6049-45a6-97a6-f7635ff1b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:35.984885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:35.999703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 703/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:36.048591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:36.050569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:36.241554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e8f21-9e0c-49eb-a9ca-6e81abf17b70 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:36.303906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:36.379451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:36.381594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:36.382043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:36.382488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:36.384274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:36.500527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:36.502815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec62e30-2d99-45c7-bfe0-0b08f0b085e2 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:36.531877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 679/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:38.692075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:38.692638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:38.692784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:38.694490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 704/1383] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:38.699834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f6d-b6c5-42dd-a7b8-d656c2ffc38b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:38.700249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f6d-b6c5-42dd-a7b8-d656c2ffc38b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:38.700367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89f6d-b6c5-42dd-a7b8-d656c2ffc38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:38.773930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-35f89f6d-b6c5-42dd-a7b8-d656c2ffc38b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:38.775177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-35f89f6d-b6c5-42dd-a7b8-d656c2ffc38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:38.777342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:38.876955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 680/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:38.921274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:38.922866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:39.069563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a6e1b-e95f-4dbe-98cb-f1bc24f8cbac None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:39.132433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:39.183496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:39.184041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:39.184297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:39.184563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:39.186203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:39.303855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:39.305470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa61d7f-ddd8-43b4-8afd-6df484956c4a service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:39.324721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 705/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:41.394117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:41.394688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:41.394688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:41.396137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 681/1386] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:41.401772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f8b-4f47-417b-a3b0-ab601f6406b9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:41.402191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f8b-4f47-417b-a3b0-ab601f6406b9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:41.402458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f8b-4f47-417b-a3b0-ab601f6406b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:41.485211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0fb16f8b-4f47-417b-a3b0-ab601f6406b9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:41.486794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0fb16f8b-4f47-417b-a3b0-ab601f6406b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:41.513512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:41.588063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 706/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:41.632476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:41.634005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:41.779771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:41.799430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc94a45-0187-44d2-a88a-c483163378dd None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:41.934399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:41.934921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:41.935198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:41.935494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:41.937085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:42.032754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:42.034427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08ac94-1479-44c4-bb1c-c1a7df133d84 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:42.039573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:42.053752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 682/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:44.182414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:44.182881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:44.183002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:44.184358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 707/1389] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:44.190103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe5a8a-cc12-470d-883b-505c574290b8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:44.190526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe5a8a-cc12-470d-883b-505c574290b8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:44.190643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe5a8a-cc12-470d-883b-505c574290b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:44.257308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2fbe5a8a-cc12-470d-883b-505c574290b8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:44.258512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2fbe5a8a-cc12-470d-883b-505c574290b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:44.352854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 683/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:44.397919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:44.399623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:44.552099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804e74-dd89-4ee1-86ac-ad00fd3c82c8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:44.561184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:44.672235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:44.672841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:44.673117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:44.673388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:44.674978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:44.766529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:44.768848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae5726-e9ea-4ce4-ae40-cce5e594bdc3 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:44.786858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 708/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:46.003587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480bd-266a-465d-af5b-72de7afc913c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.004141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480bd-266a-465d-af5b-72de7afc913c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.004141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480bd-266a-465d-af5b-72de7afc913c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.005447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 684/1392] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:46.010667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a051-c5d5-420d-bc0d-06e1d7b92ed5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.011113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a051-c5d5-420d-bc0d-06e1d7b92ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.011224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91a051-c5d5-420d-bc0d-06e1d7b92ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.026912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:46.078495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0e91a051-c5d5-420d-bc0d-06e1d7b92ed5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:46.079785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e91a051-c5d5-420d-bc0d-06e1d7b92ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:46.182843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 709/1393] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:46.230460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.230766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.231042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.232400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 685/1394] 10.222.0.17 () {54 vars in 966 bytes} [Sat Aug 6 20:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:46.237891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4c0-44be-4c3c-8114-1e9847619980 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.238287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4c0-44be-4c3c-8114-1e9847619980 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.238564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c4c0-44be-4c3c-8114-1e9847619980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.318629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8e77c4c0-44be-4c3c-8114-1e9847619980 None None] MFA Rules not processed for user `165e5c1de12b448d92f5563e600bda2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:46.319856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8e77c4c0-44be-4c3c-8114-1e9847619980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:46.355455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:46.396609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 710/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Aug 6 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:46.404113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:46.405639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:46.480874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:46.509265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4672f4f5-5aa5-4a9a-9e0c-0bd739bd13c6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:46.582681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:46.583265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.583551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.583829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.585460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:46.714676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:46.716139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413434bb-0112-4395-8c11-7a55724e5ac8 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:46.731232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:46.735592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 686/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:46.884946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.885237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.885516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.886862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 711/1397] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:46.892227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec762-b315-4924-abed-abd6f2135c9c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:46.892583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec762-b315-4924-abed-abd6f2135c9c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:46.892941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec762-b315-4924-abed-abd6f2135c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:46.963954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-026ec762-b315-4924-abed-abd6f2135c9c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:46.965986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-026ec762-b315-4924-abed-abd6f2135c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:47.076614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 687/1398] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:47.123981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:47.125670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:47.312264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33e5af-5cd3-47d6-b7c5-039515e97543 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:47.378375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:47.459060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:47.459705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:47.459985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:47.460253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:47.462150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:47.531467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409873fe-0124-4454-9d32-c3dae6d16f82 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:47.531753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409873fe-0124-4454-9d32-c3dae6d16f82 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:47.532023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409873fe-0124-4454-9d32-c3dae6d16f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:47.555235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:47.556912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c3078-16d7-4771-9927-156a75ad8ddc service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:47.576777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 712/1399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:47.608763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-409873fe-0124-4454-9d32-c3dae6d16f82 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:47.609963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-409873fe-0124-4454-9d32-c3dae6d16f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:47.640683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:47.705924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 688/1400] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:30:47.751636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:47.752004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:47.752339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:47.753756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 713/1401] 10.222.0.17 () {54 vars in 943 bytes} [Sat Aug 6 20:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:47.760534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088aac2-cee3-4080-b599-74243fb31e62 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:47.760892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088aac2-cee3-4080-b599-74243fb31e62 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:47.761230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088aac2-cee3-4080-b599-74243fb31e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:47.840317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3088aac2-cee3-4080-b599-74243fb31e62 None None] MFA Rules not processed for user `f493544ed09444499776046e5e36ec6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:47.841647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3088aac2-cee3-4080-b599-74243fb31e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:47.946210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 689/1402] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Aug 6 20:30:47 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:47.955849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:47.957490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:48.006684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:48.093480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cce237-f956-4911-9b63-4b1836cef2b8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:48.197657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:48.198234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:48.198492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:48.198760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:48.200427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:48.231017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:48.283864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:48.285453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f1902-d6ae-4f8b-8554-6e223daaafac service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:48.293464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 714/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:30:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:30:49.654064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:49.654662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:49.654662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:49.659637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 690/1404] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:49.661722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97bf1-2245-49ea-8e89-c16deb29e189 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:49.662136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97bf1-2245-49ea-8e89-c16deb29e189 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:49.662273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97bf1-2245-49ea-8e89-c16deb29e189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:49.733587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b4a97bf1-2245-49ea-8e89-c16deb29e189 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:49.734789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b4a97bf1-2245-49ea-8e89-c16deb29e189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:49.842889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 715/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:49.887902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:49.889711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:49.892736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:50.050425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16841-df1b-402c-a0ed-bac339b42bde None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:50.131678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:50.177428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:50.177920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:50.178108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:50.178372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:50.180014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:50.275653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:50.277571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf54130-1b58-407c-9271-7b3f8e144bae service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:50.295943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 691/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:30:52.352204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:52.352765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:52.352765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:52.354079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 716/1407] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:30:52.359297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfbab-30eb-48ab-8158-4c2c91948ddf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:52.359703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfbab-30eb-48ab-8158-4c2c91948ddf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:52.359882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccfbab-30eb-48ab-8158-4c2c91948ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:52.434911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ffccfbab-30eb-48ab-8158-4c2c91948ddf None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:30:52.436086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ffccfbab-30eb-48ab-8158-4c2c91948ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:52.493106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:52.595321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 692/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:30:52.642993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:30:52.644563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:52.670368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:52.837773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666220-c108-4a97-be66-3ea82aa277c4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:30:52.942548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:30:52.966261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:30:52.966940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:30:52.967837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:30:52.968284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:30:52.970915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:30:53.068642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:30:53.070384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe082c1-06ba-4865-80d2-ffa78fa6c845 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:30:53.090177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 717/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:02.588473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=26 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:03.087704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=52 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:10.247830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e3e2-d70f-49eb-b567-8cc9d30ac0bc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:10.248415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e3e2-d70f-49eb-b567-8cc9d30ac0bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:10.248415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8e3e2-d70f-49eb-b567-8cc9d30ac0bc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:10.250242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 693/1410] 10.222.0.17 () {54 vars in 918 bytes} [Sat Aug 6 20:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:10.255756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91213-876c-4f94-b126-3725eb875487 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:10.256214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91213-876c-4f94-b126-3725eb875487 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:10.256328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b91213-876c-4f94-b126-3725eb875487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:10.336306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-18b91213-876c-4f94-b126-3725eb875487 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:10.338474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-18b91213-876c-4f94-b126-3725eb875487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:10.442590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 718/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 6 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:10.457418 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276c4-c0cd-4411-9c1d-3be021bc7e21 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:10.457706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276c4-c0cd-4411-9c1d-3be021bc7e21 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:10.457977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd276c4-c0cd-4411-9c1d-3be021bc7e21 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:10.459353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 694/1412] 10.222.0.17 () {54 vars in 918 bytes} [Sat Aug 6 20:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:10.464169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13dd8d-9b11-4e98-9db8-f05d988d9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:10.464453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13dd8d-9b11-4e98-9db8-f05d988d9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:10.464722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13dd8d-9b11-4e98-9db8-f05d988d9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:10.535083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:10.538228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8d13dd8d-9b11-4e98-9db8-f05d988d9bf5 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:10.540058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8d13dd8d-9b11-4e98-9db8-f05d988d9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:10.658139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 719/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 6 20:31:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:31:13.112928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:13.113482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:13.113482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:13.114800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:13.120054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3e37-2a54-4ae8-a294-011fe196bb5a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:13.120433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3e37-2a54-4ae8-a294-011fe196bb5a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:13.120540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3e37-2a54-4ae8-a294-011fe196bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:13.185083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bbbc3e37-2a54-4ae8-a294-011fe196bb5a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:13.186274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bbbc3e37-2a54-4ae8-a294-011fe196bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:13.240735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:13.283306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:13.326369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:13.327973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:13.469512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ee1a5-566c-4cb7-8972-090f25673d82 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:13.539405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:13.579569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:13.580173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:13.580450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:13.580734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:13.582474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:13.669832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:13.672039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba6361-dbaf-4409-b7da-bec7c1288f92 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:13.689843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 696/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:14.577219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:14.577763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:14.577763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:14.579161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:14.584211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7454b-282e-4fbe-8d48-626c9f97c4a7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:14.584641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7454b-282e-4fbe-8d48-626c9f97c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:14.584759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7454b-282e-4fbe-8d48-626c9f97c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:14.659772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5ed7454b-282e-4fbe-8d48-626c9f97c4a7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:14.660960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5ed7454b-282e-4fbe-8d48-626c9f97c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:14.687207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:14.882511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:15.033620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:15.035129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:15.177031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599f748-2faa-4485-9bd7-33dc39250bab None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:15.216467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:15.290759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:15.291408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:15.291688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:15.291957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:15.293558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:15.381695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:15.383318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028e8e5-e584-4c23-ab77-69e717a9d631 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:15.401304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 722/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:16.278510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:16.279016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:16.279136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:16.280414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:16.285355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a8c-fef1-491b-aeb9-bd741012db94 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:16.285771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a8c-fef1-491b-aeb9-bd741012db94 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:16.285899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb2a8c-fef1-491b-aeb9-bd741012db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:16.343869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:16.365717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2ceb2a8c-fef1-491b-aeb9-bd741012db94 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:16.366915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2ceb2a8c-fef1-491b-aeb9-bd741012db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:16.462170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:16.617918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:16.619499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:16.762747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6f619-df40-432c-ad8f-198da9dfaccc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:16.774579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:16.872331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:16.872924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:16.873194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:16.873461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:16.875021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:16.959652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:16.961508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0bcc2-6aa9-44ac-94a2-99c32588c456 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:16.981366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 699/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:17.904057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:17.904592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:17.904592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:17.905845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:17.910753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3c91-7e52-4b97-9115-4d4ebc0c4520 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:17.911196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3c91-7e52-4b97-9115-4d4ebc0c4520 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:17.911333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3c91-7e52-4b97-9115-4d4ebc0c4520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:17.931491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:17.988779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f67b3c91-7e52-4b97-9115-4d4ebc0c4520 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:17.989983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f67b3c91-7e52-4b97-9115-4d4ebc0c4520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:18.090612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:31:18.241478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:18.243008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:18.352405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:18.390858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beda9e5-8514-42ec-888a-e0ac34f22f9d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:18.502480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:18.503007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:18.503314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:18.503582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:18.505164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:18.579419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:18.593949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:18.595580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dea3e7-a8f9-4006-a864-2bde5fe791e3 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:18.613966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 725/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:19.466783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:19.467398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:19.467398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:19.468823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:19.473696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98464f-d8a5-4c99-97c2-24fe8ca35e79 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:19.474097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98464f-d8a5-4c99-97c2-24fe8ca35e79 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:19.474241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98464f-d8a5-4c99-97c2-24fe8ca35e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:19.548646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2b98464f-d8a5-4c99-97c2-24fe8ca35e79 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:19.549832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2b98464f-d8a5-4c99-97c2-24fe8ca35e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:19.646679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:19.796983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:19.798414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:19.878796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:19.937872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb069f-83b3-484b-a41a-7b736b4e18e9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:20.047744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a239835-bb38-4f16-8440-af75514394db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:20.048265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239835-bb38-4f16-8440-af75514394db service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:20.048537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239835-bb38-4f16-8440-af75514394db service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:20.048805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a239835-bb38-4f16-8440-af75514394db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:20.050372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2a239835-bb38-4f16-8440-af75514394db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:20.096288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:20.136951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a239835-bb38-4f16-8440-af75514394db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:20.138511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a239835-bb38-4f16-8440-af75514394db service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:20.155798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 702/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:31:20.955463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:20.956055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:20.956055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:20.957264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:20.962329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384e8e-b399-48fa-a5b9-a6934f6d53bc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:20.962765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384e8e-b399-48fa-a5b9-a6934f6d53bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:20.962872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384e8e-b399-48fa-a5b9-a6934f6d53bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:21.042386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8f384e8e-b399-48fa-a5b9-a6934f6d53bc None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:21.043607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f384e8e-b399-48fa-a5b9-a6934f6d53bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:21.134656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:21.282623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:21.284103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:21.332514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:21.429611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825150-a410-4263-abce-7ac82f5c9131 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:21.539079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:21.539667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:21.539943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:21.540208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:21.541786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:21.549075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:21.633995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:21.635650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c395ed-2872-4bb5-a373-c92724d9717c service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:21.653427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 728/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:22.469411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:22.469946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:22.469946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:22.471266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:22.476237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d049-bd8f-4059-aa0d-e566a292e6ae None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:22.476682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d049-bd8f-4059-aa0d-e566a292e6ae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:22.476799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d049-bd8f-4059-aa0d-e566a292e6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:22.550774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0b94d049-bd8f-4059-aa0d-e566a292e6ae None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:22.552001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0b94d049-bd8f-4059-aa0d-e566a292e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:22.619041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:22.648095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:22.802785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:22.804253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:22.821608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:22.947392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfefda-a14b-48d4-8326-fe520b1522f8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:23.033865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:23.061769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:23.062298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:23.062593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:23.062842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:23.064476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:23.150455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:23.152051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad729f2-50a9-4ec0-804f-b523ad2d475c service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:23.169609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 705/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:23.960748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:23.961285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:23.961285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:23.962573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:23.967655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979c2f-5a7f-40fa-9087-853453e0d917 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:23.968127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979c2f-5a7f-40fa-9087-853453e0d917 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:23.968246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a979c2f-5a7f-40fa-9087-853453e0d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:24.042928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3a979c2f-5a7f-40fa-9087-853453e0d917 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:24.044151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3a979c2f-5a7f-40fa-9087-853453e0d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:24.084973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:24.138794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:24.296002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:24.297460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:24.442362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b76da-0f9b-475a-bb1d-1c87443407f0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:24.497890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:24.555786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:24.556343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:24.556616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:24.556879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:24.558713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:24.646180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:24.647801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ea4c-216e-4fb1-911e-05e774a9e448 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:24.665761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 731/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:25.471358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:25.471933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:25.471933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:25.473287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:25.478163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5fe6-d06e-4e49-99fb-6a52de41aa0b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:25.478567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5fe6-d06e-4e49-99fb-6a52de41aa0b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:25.478744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb5fe6-d06e-4e49-99fb-6a52de41aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:25.553750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1bcb5fe6-d06e-4e49-99fb-6a52de41aa0b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:25.554891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1bcb5fe6-d06e-4e49-99fb-6a52de41aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:25.556936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:25.653092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:25.835820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:25.837342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:25.982184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9bc68-84fc-46e2-b635-46719f530b7d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:26.009018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:26.094461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:26.094987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:26.095276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:26.095545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:26.097139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:26.186460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:26.188083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc504275-ef7e-4e48-9d5d-79abfea447c6 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:26.206292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 708/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:28.074889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:28.075441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:28.075441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:28.077401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:28.082438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c937-054c-44eb-842a-9d74b15674cc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:28.082867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c937-054c-44eb-842a-9d74b15674cc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:28.082971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7c937-054c-44eb-842a-9d74b15674cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:28.122580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:28.147892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ecf7c937-054c-44eb-842a-9d74b15674cc None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:28.149075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ecf7c937-054c-44eb-842a-9d74b15674cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:28.243666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:28.281969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:28.283522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:28.387622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2e156-1569-473e-8bfe-b6982751f3dd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:28.418712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:28.460501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:28.461102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:28.461376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:28.461639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:28.463223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:28.572403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:28.573869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaed296-20bf-44cb-aa84-cca5dd2fb9ad service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:28.593761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 734/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:30.800374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:30.800936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:30.800936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:30.802230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:30.807386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930782-12a4-42a1-82ae-98198e36f0ff None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:30.807779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930782-12a4-42a1-82ae-98198e36f0ff None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:30.807933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930782-12a4-42a1-82ae-98198e36f0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:30.873432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-19930782-12a4-42a1-82ae-98198e36f0ff None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:30.874559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-19930782-12a4-42a1-82ae-98198e36f0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:30.886983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:30.971137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:31.009142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:31.010700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:31.110407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b356e47-82aa-40d2-9fad-cfdee31a8649 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:31.121952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:31.182764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:31.183311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:31.183590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:31.183856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:31.185466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:31.289916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:31.291358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9395b5-b6d5-41ce-ab38-c17ff8a35ac3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:31.309201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 711/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:33.609324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:33.609774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:33.609896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:33.611278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:33.616501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147a25-e9d9-4dfc-b900-7a8bb7a7f3cf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:33.616929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147a25-e9d9-4dfc-b900-7a8bb7a7f3cf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:33.617072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a147a25-e9d9-4dfc-b900-7a8bb7a7f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:33.664560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:33.682523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5a147a25-e9d9-4dfc-b900-7a8bb7a7f3cf None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:33.683759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5a147a25-e9d9-4dfc-b900-7a8bb7a7f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:33.777708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:33.816450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:33.818072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:33.920100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029503-d6b1-479e-b96c-0deaa8b603f0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:33.960285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:33.993768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:33.994359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:33.994664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:33.994931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:33.996543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:34.103823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:34.105241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b4e4f-7662-4283-9d72-2add7c1704b3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:34.123073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 737/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:36.215880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:36.216801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:36.216941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:36.218292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:36.223388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673684fc-5e6c-454b-8a3d-9eb955b4ca1d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:36.223766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673684fc-5e6c-454b-8a3d-9eb955b4ca1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:36.223934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673684fc-5e6c-454b-8a3d-9eb955b4ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:36.288176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-673684fc-5e6c-454b-8a3d-9eb955b4ca1d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:36.289371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-673684fc-5e6c-454b-8a3d-9eb955b4ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:36.309560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:36.385865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:36.424594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:36.426124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:36.526166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e57b0-577d-42e7-b60e-938296dfdc93 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:36.547734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:36.601312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:36.601603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:36.601878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:36.602144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:36.603767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:36.713382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:36.714816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d7b4c-6770-4710-ab13-c602c5416441 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:36.733036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 714/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:38.764037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:38.764566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:38.764678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:38.765974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:38.771326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fd27-a17d-4d80-beef-179420e2f3ab None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:38.771728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fd27-a17d-4d80-beef-179420e2f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:38.771874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fd27-a17d-4d80-beef-179420e2f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:38.835084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:38.838155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1714fd27-a17d-4d80-beef-179420e2f3ab None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:38.839983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1714fd27-a17d-4d80-beef-179420e2f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:38.933772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:38.972774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:38.974354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:39.074752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f744d-8e09-45d4-9cec-71186dc5e2ce None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:39.122956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:39.147206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:39.147823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:39.148097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:39.148362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:39.149918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:39.257922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:39.259298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4ab09-0b42-4e1e-b41f-9c3ffa5ff903 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:39.277439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 740/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:41.370156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:41.370693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:41.370815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:41.372105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:41.377358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f14c2-87a4-4730-8133-965694987fae None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:41.377766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f14c2-87a4-4730-8133-965694987fae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:41.377921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f14c2-87a4-4730-8133-965694987fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:41.444062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-912f14c2-87a4-4730-8133-965694987fae None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:41.445284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-912f14c2-87a4-4730-8133-965694987fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:41.476400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:41.545063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:41.583968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:41.585818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:41.686554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d007386-7200-4efc-abf1-586786a7ad61 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:41.718639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:41.767255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:41.767890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:41.768163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:41.768424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:41.770044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:41.877175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:41.878593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e29cb0-72eb-443e-985e-4a8200942b18 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:41.896090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 717/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:43.922709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:43.923341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:43.923341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:43.924523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:43.929752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae43b9-5ea6-4cfb-9077-ad59b4b4d388 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:43.930161 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae43b9-5ea6-4cfb-9077-ad59b4b4d388 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:43.930280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae43b9-5ea6-4cfb-9077-ad59b4b4d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:43.994790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ffae43b9-5ea6-4cfb-9077-ad59b4b4d388 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:43.996021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ffae43b9-5ea6-4cfb-9077-ad59b4b4d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:44.004144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:44.090850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:44.129189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:44.130706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:44.233053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ad74-43a0-44e7-bdaa-971e4c21da15 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:44.286768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:44.305311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:44.305936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:44.306211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:44.306469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:44.308077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:44.416670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:44.418090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14bd02-fb07-428f-aaf7-36483eb62850 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:44.436145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 743/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:46.459698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:46.460226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:46.460226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:46.461491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:46.466655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489465c2-b04d-48dc-bed8-4fcda6358326 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:46.467067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489465c2-b04d-48dc-bed8-4fcda6358326 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:46.467196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489465c2-b04d-48dc-bed8-4fcda6358326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:46.533013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-489465c2-b04d-48dc-bed8-4fcda6358326 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:46.534241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-489465c2-b04d-48dc-bed8-4fcda6358326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:46.694048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:46.752767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:46.790328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:46.791893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:46.894826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b5639-580f-4e93-a19d-7be13e504809 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:46.930266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:46.967265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:46.967871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:46.968148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:46.968417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:46.970013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:47.080242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:47.081666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1538-8774-43a0-9cd8-d9b73f92a035 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:47.099234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 720/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:49.100035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:49.100591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:49.100591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:49.101888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:49.107108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d47d-f551-4276-b8bc-eb7f15e513da None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:49.107561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d47d-f551-4276-b8bc-eb7f15e513da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:49.107692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d47d-f551-4276-b8bc-eb7f15e513da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:49.172688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0445d47d-f551-4276-b8bc-eb7f15e513da None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:49.173883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0445d47d-f551-4276-b8bc-eb7f15e513da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:49.191853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:49.268227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:49.304100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:49.305635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:49.406893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea3416-bc9d-4c5f-bc8b-9ba95cb17e37 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:49.471775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:49.478915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:49.479536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:49.479810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:49.480073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:49.482163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:49.586206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:49.587662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5c8cb-db38-416a-be24-208cb038bdf3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:49.605414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 746/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:31:51.583679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:51.584562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:51.584562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:51.585839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:31:51.591559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cf61-6299-4eb2-bf78-349d5e62efb6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:51.591964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cf61-6299-4eb2-bf78-349d5e62efb6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:51.592100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65cf61-6299-4eb2-bf78-349d5e62efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:51.655777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8d65cf61-6299-4eb2-bf78-349d5e62efb6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:31:51.656967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8d65cf61-6299-4eb2-bf78-349d5e62efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:51.704214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:51.753343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:31:51.790154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:31:51.791736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:51.892997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74e49-e32c-4551-8fd4-23559ea756de None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:31:51.939862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:31:51.966406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:31:51.967019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:31:51.967310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:31:51.967580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:31:51.969167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:31:52.073939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:31:52.075957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15cbc9-51dd-4fc4-85e6-934fa5c8c719 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:31:52.093690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 723/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:01.751562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=22 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:02.091484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=66 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:11.435694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fdf15-cbac-4220-bd95-1d1e49f41dc5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:11.436246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fdf15-cbac-4220-bd95-1d1e49f41dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:11.436246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fdf15-cbac-4220-bd95-1d1e49f41dc5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:11.437556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 748/1471] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:11.442952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c03dd-e019-4c1c-bd91-6a50a885166c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:11.443449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c03dd-e019-4c1c-bd91-6a50a885166c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:11.443531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c03dd-e019-4c1c-bd91-6a50a885166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:11.512719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-624c03dd-e019-4c1c-bd91-6a50a885166c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:11.513941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-624c03dd-e019-4c1c-bd91-6a50a885166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:11.621256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 724/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:11.708221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:11.708780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:11.708957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:11.710336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 749/1473] 10.222.0.17 () {54 vars in 966 bytes} [Sat Aug 6 20:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:11.717326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5164df-ff33-4f6f-8dc9-0200c6f7d532 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:11.717604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5164df-ff33-4f6f-8dc9-0200c6f7d532 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:11.717869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5164df-ff33-4f6f-8dc9-0200c6f7d532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:11.801557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1d5164df-ff33-4f6f-8dc9-0200c6f7d532 None None] MFA Rules not processed for user `165e5c1de12b448d92f5563e600bda2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:11.802783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1d5164df-ff33-4f6f-8dc9-0200c6f7d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:11.824846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:11.888857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 725/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Aug 6 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:11.896609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:11.898144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:12.007485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd01c2-8aed-4dfa-9516-bbeb022fa5cb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:12.082311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:12.082908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:12.083174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:12.083463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:12.085329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:12.139841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:12.204375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:12.205824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a1b6-1473-47f6-93bb-e0167a3181e7 service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:12.225409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 750/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:14.374415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:14.374953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:14.374953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:14.376489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 726/1476] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:14.381694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeeed1-f892-4a3c-a70d-69968c7647b5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:14.382159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeeed1-f892-4a3c-a70d-69968c7647b5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:14.382256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeeed1-f892-4a3c-a70d-69968c7647b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:14.451075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5cdeeed1-f892-4a3c-a70d-69968c7647b5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:14.452309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5cdeeed1-f892-4a3c-a70d-69968c7647b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:14.550611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 751/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:14.573783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:14.575436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:14.709261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422d7c7-6902-4510-b372-4afc8ae2ec63 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:14.761344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:14.807178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:14.807810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:14.808091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:14.808352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:14.808981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:14.810691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:32:14.810691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:32:14.810691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:32:14.811862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3ab6b-f7e8-4d8d-81bb-5d61acc1ce40 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:14.830747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 727/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 20:32:14 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:32:16.847820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:16.848385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:16.848385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:16.849695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 752/1479] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:16.854981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5824-e1ed-4e33-9688-21a0efcda344 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:16.855416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5824-e1ed-4e33-9688-21a0efcda344 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:16.855527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5824-e1ed-4e33-9688-21a0efcda344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:16.920426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a86e5824-e1ed-4e33-9688-21a0efcda344 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:16.921651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a86e5824-e1ed-4e33-9688-21a0efcda344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:17.016803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 728/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:17.060322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:17.061941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:17.072003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:17.206195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb25451-b9bb-4a3f-bf42-982ac3b03f09 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:17.290219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:17.325279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:17.325749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:17.326199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:17.326389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:17.328191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:17.419275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:17.420886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b6567-426a-4127-998d-0337798c5da5 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:17.439365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 753/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:19.620357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:19.620825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:19.620929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:19.622218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 729/1482] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:19.627332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2ba43-f6d3-4527-9345-f6323bf32004 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:19.627813 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2ba43-f6d3-4527-9345-f6323bf32004 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:19.627909 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2ba43-f6d3-4527-9345-f6323bf32004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:19.700578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d0b2ba43-f6d3-4527-9345-f6323bf32004 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:19.701824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0b2ba43-f6d3-4527-9345-f6323bf32004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:19.746582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:19.795706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 754/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:19.832583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:19.834409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:19.857404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:19.936226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19771fcf-52fc-47ec-9150-c0999a70c6ab None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:20.008605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:20.009199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:20.009473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:20.009739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:20.011988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:20.083913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:20.118411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:20.120357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd712e3f-36d0-4661-bc8a-89e77afe8bce service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:20.139669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 730/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:22.183416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:22.184063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:22.184063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:22.185304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 755/1485] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:22.190627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e905-1be6-492f-9d24-8a6b757ac86c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:22.191066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e905-1be6-492f-9d24-8a6b757ac86c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:22.191175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5e905-1be6-492f-9d24-8a6b757ac86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:22.256552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0aa5e905-1be6-492f-9d24-8a6b757ac86c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:22.257872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0aa5e905-1be6-492f-9d24-8a6b757ac86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:22.352538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 731/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:22.390815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:22.392444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:22.497584 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a4628-cb10-4b5d-b517-4b210b406ce9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:22.576401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:22.578590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:22.579200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:22.579750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:22.580250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:22.582077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:22.694941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:22.696402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2495a8-369a-4420-b6e2-83a9024daec2 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:22.714557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 756/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:24.861270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:24.861810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:24.861810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:24.863053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 732/1488] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:24.868276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b98ea-a804-47b4-b3ed-a2e98d89d94d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:24.868724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b98ea-a804-47b4-b3ed-a2e98d89d94d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:24.868830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b98ea-a804-47b4-b3ed-a2e98d89d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:24.936737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e95b98ea-a804-47b4-b3ed-a2e98d89d94d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:24.937933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e95b98ea-a804-47b4-b3ed-a2e98d89d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:24.991872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:25.037991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 757/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:25.078177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:25.079749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:25.115504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:25.180818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6245621-4dd1-41d9-a38c-d8597a811d1c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:25.251840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:25.252444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:25.252721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:25.252988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:25.254577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:25.334078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:25.362811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:25.364252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed474c6a-bb7f-4dde-98d8-f6f0cb85f842 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:25.381542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 733/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:27.590891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:27.591472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:27.591472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:27.592803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 758/1491] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 20:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:32:27.597943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3a09-5d75-4a04-8b39-2bfc5885e754 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:27.598435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3a09-5d75-4a04-8b39-2bfc5885e754 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:27.598573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3a09-5d75-4a04-8b39-2bfc5885e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:27.664038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3a9f3a09-5d75-4a04-8b39-2bfc5885e754 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:32:27.665247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3a9f3a09-5d75-4a04-8b39-2bfc5885e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:27.766604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 734/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:32:27.805944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:32:27.807558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:27.909790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88054b50-9dd7-41af-9052-3456b5d8a06c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:32:27.991214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:32:27.991851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:32:27.992181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:32:27.992686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:32:27.996320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:32:28.006847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:28.117981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:32:28.119962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f83dc-9667-4f28-9d60-65037a83c964 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:32:28.138230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 759/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:32:37.764853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:32:38.135984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=50 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:44.405961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:44.406534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:44.406534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:44.480817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:33:44.482001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:44.583035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 735/1494] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:33:44.591717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:44.592314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:44.592314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:44.668686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:33:44.669872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:44.766656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 760/1495] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:33:44.771441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:44.773265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:44.784458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f306c1f-4ddf-4efe-a16b-63b5394116f2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:44.844284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:44.883576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:44.884180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:44.884457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:44.884724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:44.885353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:33:44.885650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:44.886659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:44.886659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:33:44.886659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:33:44.887565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:44.899076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 736/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:33:44.907614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:44.916689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2fe1b-9f26-464a-926b-a1279008d2f1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:44.977036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:45.010199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:45.010852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.011125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.011425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.012059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:45.013774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:45.013774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:33:45.013774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:33:45.014998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:45.070755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 761/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:33:44 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:33:45.075427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:45.077007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:45.110068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c5f27-8e2d-42af-9bb5-e3dfa2854870 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:45.209040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:45.210238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.210513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.210776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.211423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:45.212410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:45.212410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:33:45.212410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:33:45.213605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:45.253897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 737/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:33:45 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:33:45.258240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:45.259856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:45.320623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f3a63-0761-4b36-877d-8bea50fdb519 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:45.402613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:45.414086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:45.414682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.414954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.415214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.415870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:45.416867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:45.416867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:33:45.416867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:33:45.417735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:45.430312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 762/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:33:45.434274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:45.435812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:45.447460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e82d3-2e1d-4f96-9994-b02ca96aadfa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:45.471730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:45.544427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:45.545025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.545297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.545561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.546185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:45.547173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:45.547173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:33:45.547173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:33:45.548074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a72ef-957d-499c-bc7c-7f4082decaa9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:45.560026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 738/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:33:45.564250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:45.565809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:45.599884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcae2f-ff68-45ff-91d8-3431b8425a4b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:45.691499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:45.692067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.692340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.692607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] PATH_INFO: `/v3/projects/4227ea08c44b483492ee87426cb9694f/users/800d2e289e4e4e1ab29748e1f14f229c/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.714900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4227ea08c44b483492ee87426cb9694f, user_id=800d2e289e4e4e1ab29748e1f14f229c, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:45.715956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:45.715956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:33:45.715956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:33:45.717864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc23b-ee1d-4150-9529-6a44f30caf6f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:45.741026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 763/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:33:45 2022] PUT /identity/v3/projects/4227ea08c44b483492ee87426cb9694f/users/800d2e289e4e4e1ab29748e1f14f229c/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:33:45.753162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845696-0e92-476d-913c-59007496c4b2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.753467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845696-0e92-476d-913c-59007496c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.753775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845696-0e92-476d-913c-59007496c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.812257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ad845696-0e92-476d-913c-59007496c4b2 None None] MFA Rules not processed for user `800d2e289e4e4e1ab29748e1f14f229c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:33:45.813461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ad845696-0e92-476d-913c-59007496c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:45.890750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 739/1502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:33:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:33:45.903925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.904208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.904478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.905808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 764/1503] 10.222.0.17 () {54 vars in 964 bytes} [Sat Aug 6 20:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:33:45.910462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b88ce-db1d-4175-82aa-7b71d4d7eafb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:45.910749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b88ce-db1d-4175-82aa-7b71d4d7eafb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:45.911019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b88ce-db1d-4175-82aa-7b71d4d7eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:45.941350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:45.985000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-494b88ce-db1d-4175-82aa-7b71d4d7eafb None None] MFA Rules not processed for user `29f9cc8a29c4481491d319883cab7056`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:33:45.986130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-494b88ce-db1d-4175-82aa-7b71d4d7eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:46.059959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 740/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Aug 6 20:33:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:33:46.067793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:46.069434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:46.118578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:46.172137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe6ba-812e-41a5-864c-9fd0648b38ba None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:46.248046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:46.248560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:46.248833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:46.249095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:46.250664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:46.347475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:46.348894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:46.352337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:46.366899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 765/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:33:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:33:46.412625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978b47-0a76-4f21-a693-3e2531e7b9e0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:46.412914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978b47-0a76-4f21-a693-3e2531e7b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:46.413214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2978b47-0a76-4f21-a693-3e2531e7b9e0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:46.414456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 741/1506] 10.222.0.17 () {52 vars in 830 bytes} [Sat Aug 6 20:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:33:46.417985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:46.419194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:46.518464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9573efb-0cea-4a0d-a18b-b41b8f269740 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:46.610290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:46.610912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:46.611187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:46.611478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] PATH_INFO: `/v3/users/800d2e289e4e4e1ab29748e1f14f229c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:46.624355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d2e289e4e4e1ab29748e1f14f229c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:46.625412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:46.625412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:33:46.625412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:33:46.626753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:46.638486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:46.693457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d2e289e4e4e1ab29748e1f14f229c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:46.707922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d2e289e4e4e1ab29748e1f14f229c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:46.716741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d2e289e4e4e1ab29748e1f14f229c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:46.717206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d2e289e4e4e1ab29748e1f14f229c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:46.739623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d2e289e4e4e1ab29748e1f14f229c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:46.745916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 766/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:33:46 2022] DELETE /identity/v3/users/800d2e289e4e4e1ab29748e1f14f229c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:33:46.750206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:46.750684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:46.750788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:46.807211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:33:46.808363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:46.882784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:46.894574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 742/1508] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:33:46.904657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:46.905863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:47.004841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93b42f-58fc-4615-98f4-711d99d7f422 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:47.058238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:47.079021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:47.079651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:47.079926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:47.080192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:47.082042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:47.186713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:47.188157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159af24-7571-453f-8b3c-057ea270cb00 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:47.206704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 767/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:33:47.536443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:33:47.538217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:33:47.551387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec62b0d-cca7-450e-9011-29c9bb49f010 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:33:47.646299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:33:47.647455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:33:47.647731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:33:47.647999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] PATH_INFO: `/v3/projects/4227ea08c44b483492ee87426cb9694f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:33:47.658001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4227ea08c44b483492ee87426cb9694f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:33:47.659020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:33:47.659020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:33:47.659020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:33:47.660296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:33:47.716308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4227ea08c44b483492ee87426cb9694f', 'request_id': 'req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:47.722214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4227ea08c44b483492ee87426cb9694f', 'request_id': 'req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:47.735452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4227ea08c44b483492ee87426cb9694f', 'request_id': 'req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:47.761350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] The token cache is being invalidate because project 4227ea08c44b483492ee87426cb9694f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:33:47.761960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:47.762059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0b9e8fe7-e401-4de5-affe-ddcd578dd5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:33:47.763421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 743/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:33:47 2022] DELETE /identity/v3/projects/4227ea08c44b483492ee87426cb9694f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:33:57.204308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=62 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:33:57.759421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:15.445841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:15.446418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:15.446418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:15.447728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:15.452381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7764-5a9c-4a28-820a-aef71961dd50 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:15.452780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7764-5a9c-4a28-820a-aef71961dd50 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:15.452923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7764-5a9c-4a28-820a-aef71961dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:15.532760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-25cb7764-5a9c-4a28-820a-aef71961dd50 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:15.533958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-25cb7764-5a9c-4a28-820a-aef71961dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:15.637269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:15.793076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:15.795137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:15.911314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258649-a0d7-4696-aa84-1d3ca2b37941 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:15.916681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:15.917273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:15.917550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:15.917816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:15.925627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:15.927192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1c546-3f57-42e6-8ef9-48e050bdd434 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:15.936460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 769/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:16.761046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd3b6-f04a-4099-b975-5bc26fc3bdc0 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.761625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd3b6-f04a-4099-b975-5bc26fc3bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.761625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bd3b6-f04a-4099-b975-5bc26fc3bdc0 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.762927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:16.767855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d379d-2092-4652-876d-f2f8ec4ee04f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.768285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d379d-2092-4652-876d-f2f8ec4ee04f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.768391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d379d-2092-4652-876d-f2f8ec4ee04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.787460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cd9d379d-2092-4652-876d-f2f8ec4ee04f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:16.788648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cd9d379d-2092-4652-876d-f2f8ec4ee04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:16.796422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:16.947989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bd3b6-f04a-4099-b975-5bc26fc3bdc0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:16.962144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bd3b6-f04a-4099-b975-5bc26fc3bdc0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:16.967566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:16.968152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:16.968429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:16.968699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:16.977111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:16.978681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b7d16-c706-4037-b628-6975b4a97958 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:16.988451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 746/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:17.060424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f123d3-5efe-4eb1-a522-f318ec759c9a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.060705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f123d3-5efe-4eb1-a522-f318ec759c9a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.060991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f123d3-5efe-4eb1-a522-f318ec759c9a None None] PATH_INFO: `/v3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.062343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 771/1517] 10.222.0.30 () {54 vars in 925 bytes} [Sat Aug 6 20:35:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:35:17.073176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5063a9-0e41-49ab-bc12-7ba379bb3a72 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:17.073464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5063a9-0e41-49ab-bc12-7ba379bb3a72 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:17.073743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5063a9-0e41-49ab-bc12-7ba379bb3a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:17.134441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-db5063a9-0e41-49ab-bc12-7ba379bb3a72 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:17.135658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-db5063a9-0e41-49ab-bc12-7ba379bb3a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:17.151695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:17.204676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 747/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Aug 6 20:35:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:26.059908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ae594-3163-43b0-a8e5-a6d135236a28 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:26.060454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ae594-3163-43b0-a8e5-a6d135236a28 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:26.060454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ae594-3163-43b0-a8e5-a6d135236a28 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:26.061771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 772/1519] 10.222.0.17 () {54 vars in 961 bytes} [Sat Aug 6 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:26.066731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddae1b1-5c99-45ff-86eb-080ee0f3e522 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:26.067709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddae1b1-5c99-45ff-86eb-080ee0f3e522 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:26.067829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddae1b1-5c99-45ff-86eb-080ee0f3e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:26.087517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3ddae1b1-5c99-45ff-86eb-080ee0f3e522 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:26.088687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ddae1b1-5c99-45ff-86eb-080ee0f3e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:26.097016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 748/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Aug 6 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:35:26.105168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ae594-3163-43b0-a8e5-a6d135236a28 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:26.118329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ae594-3163-43b0-a8e5-a6d135236a28 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:26.123188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:26.123810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:26.124085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:26.124352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:26.132990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:26.134550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab1955-68a2-48b1-9b55-eb560560cc38 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:26.144001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 773/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:28.243520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268309d-d79a-4fa4-b506-cce3c09975b3 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:28.244123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268309d-d79a-4fa4-b506-cce3c09975b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:28.244123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268309d-d79a-4fa4-b506-cce3c09975b3 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:28.245393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:28.250610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ab40-de10-4b51-a208-dfe4f531a5c3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:28.251016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ab40-de10-4b51-a208-dfe4f531a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:28.251124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043ab40-de10-4b51-a208-dfe4f531a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:28.271212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7043ab40-de10-4b51-a208-dfe4f531a5c3 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:28.273144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7043ab40-de10-4b51-a208-dfe4f531a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:28.280986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:35:28.440849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268309d-d79a-4fa4-b506-cce3c09975b3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:28.462567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268309d-d79a-4fa4-b506-cce3c09975b3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:28.468172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:28.468814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:28.469148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:28.469416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:28.477843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:28.479443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dc25c-3a9e-49ca-b7c6-e662bc3db435 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:28.488655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 750/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:29.322634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d1db-958e-4bfc-afaf-9487156ff10e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:29.323182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d1db-958e-4bfc-afaf-9487156ff10e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:29.323182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7d1db-958e-4bfc-afaf-9487156ff10e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:29.324532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 20:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:29.329176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaa1-e5d2-4eed-a7d2-991b3b0b83fb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:29.329590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaa1-e5d2-4eed-a7d2-991b3b0b83fb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:29.329718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaa1-e5d2-4eed-a7d2-991b3b0b83fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:29.349269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1abdaaa1-e5d2-4eed-a7d2-991b3b0b83fb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:29.351033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1abdaaa1-e5d2-4eed-a7d2-991b3b0b83fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:29.358999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 20:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:29.507478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d1db-958e-4bfc-afaf-9487156ff10e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:29.521475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7d1db-958e-4bfc-afaf-9487156ff10e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:29.527310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:29.527889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:29.528162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:29.528426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:29.536222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:29.538503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc1c93-2bfb-495a-8e6b-09c085ba45f6 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:29.548017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 776/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:33.405620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.406203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.406203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.407538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:33.413036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757af5-2a2c-4740-a748-c2419a13e6ed None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.413439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757af5-2a2c-4740-a748-c2419a13e6ed None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.413567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757af5-2a2c-4740-a748-c2419a13e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.432765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dd757af5-2a2c-4740-a748-c2419a13e6ed None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:33.433938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dd757af5-2a2c-4740-a748-c2419a13e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:33.441553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:33.513837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:33.515597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:33.592897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55f92-ab94-4494-a8ae-6f21a11b4fee None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:33.596750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:33.597560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:33.597834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:33.598102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:33.608730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:33.610136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a612e-31be-4010-bee6-86d27eb245d0 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:33.620133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 753/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:35.604658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01dccf-308c-46e5-82a8-ca77887553ad None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:35.605089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01dccf-308c-46e5-82a8-ca77887553ad None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:35.605192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01dccf-308c-46e5-82a8-ca77887553ad None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:35.606543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:35.611660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c522e2-6dd4-4332-b9bf-08ed7cfb8aa7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:35.612121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c522e2-6dd4-4332-b9bf-08ed7cfb8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:35.612241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c522e2-6dd4-4332-b9bf-08ed7cfb8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:35.631801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a9c522e2-6dd4-4332-b9bf-08ed7cfb8aa7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:35.632971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a9c522e2-6dd4-4332-b9bf-08ed7cfb8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:35.640585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:35.676049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01dccf-308c-46e5-82a8-ca77887553ad None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:35.686747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01dccf-308c-46e5-82a8-ca77887553ad None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:35.690205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:35.690788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:35.691059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:35.691350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:35.700435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:35.701873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2548-25de-4606-ba4f-8c85b2d2e1fe service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:35.711994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 779/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:39.143591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.144148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.144148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.145447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:39.150968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fed5-f3ff-41df-9e8e-6ec443b9a20d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.151425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fed5-f3ff-41df-9e8e-6ec443b9a20d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.151530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1fed5-f3ff-41df-9e8e-6ec443b9a20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.158987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=81 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.172011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4fd1fed5-f3ff-41df-9e8e-6ec443b9a20d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:39.173188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4fd1fed5-f3ff-41df-9e8e-6ec443b9a20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:39.181859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:39.482952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:39.484654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:39.547108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:39.560925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92d5fc-e0dd-4444-8ab6-3259db5dab27 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:39.564474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:39.565067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:39.565340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:39.565608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:39.574586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:39.576011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43609d5-2259-4b0f-8460-a13d32aa39ea service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:39.585898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 756/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:41.612452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.612875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.612997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.614366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:35:41.619429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb626b-f1d2-4b5c-8a9c-dc1a72605a13 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.619814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb626b-f1d2-4b5c-8a9c-dc1a72605a13 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.619978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb626b-f1d2-4b5c-8a9c-dc1a72605a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.639363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-feeb626b-f1d2-4b5c-8a9c-dc1a72605a13 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:35:41.640653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-feeb626b-f1d2-4b5c-8a9c-dc1a72605a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:41.649072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:35:41.954767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:35:41.956688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:35:41.970120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62c141-db9b-4a8e-a288-48c30b6c1ecd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:35:41.973616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:35:41.974201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:35:41.974500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:35:41.974767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:35:41.983647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:35:41.985041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525e2b7-6fd0-4adc-b1ca-71c51cd55c46 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:35:41.994749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 782/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:35:51.634674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=11 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:35:51.990191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=8 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.185936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a55e-2ab7-4b80-911d-6660c1bc5551 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.186602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a55e-2ab7-4b80-911d-6660c1bc5551 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.186602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45a55e-2ab7-4b80-911d-6660c1bc5551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.204665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9271-b6fb-44e7-972b-e0cf9e5490ba None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.206464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9271-b6fb-44e7-972b-e0cf9e5490ba None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.206464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9271-b6fb-44e7-972b-e0cf9e5490ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.218345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2e45a55e-2ab7-4b80-911d-6660c1bc5551 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.219783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2e45a55e-2ab7-4b80-911d-6660c1bc5551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.237273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 758/1540] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:04.239406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae38f-bd18-438f-bdf7-6c2322cb37c6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.239689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae38f-bd18-438f-bdf7-6c2322cb37c6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.240163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ae38f-bd18-438f-bdf7-6c2322cb37c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.241338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-47ab9271-b6fb-44e7-972b-e0cf9e5490ba None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.242762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-47ab9271-b6fb-44e7-972b-e0cf9e5490ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.261362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 783/1541] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:04.268601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4b7b-65e2-4187-bbd2-d7508eae4ecf None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.268852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e20ae38f-bd18-438f-bdf7-6c2322cb37c6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.269560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4b7b-65e2-4187-bbd2-d7508eae4ecf None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.270045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e4b7b-65e2-4187-bbd2-d7508eae4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.270153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e20ae38f-bd18-438f-bdf7-6c2322cb37c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.291049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 759/1542] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.292429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.292712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.292977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.308075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-050e4b7b-65e2-4187-bbd2-d7508eae4ecf None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.309684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-050e4b7b-65e2-4187-bbd2-d7508eae4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.325936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 784/1543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:04.327703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.328251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.328732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.336447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.337699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.363272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 760/1544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.363272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.367429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.369633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.373002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d3caa-679d-483c-9de8-e722964716e7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.387640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.388258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.388537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.388807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.389575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.389880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.391497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d9977-df74-4bac-93d9-4abb1308929e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.391792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 785/1545] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.392810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.407271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59c3e-1a57-4127-bafb-3b20c4652474 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.417845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 761/1546] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.418705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.418955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.419258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.419537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.420220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.420720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.421190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.422037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.422547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.423774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:04.423774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:37:04.423774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:37:04.426160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.446609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 786/1547] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.451920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.459728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.460976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.463472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171dfcd-6525-4f0c-b72a-1a43e4a52c42 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.480068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.480890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 762/1548] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.481552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.481829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.482300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.482804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.483721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.484221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.486027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.499114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10b1c8-24e4-4ad0-a0fd-2e88407b6d4d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.508146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 787/1549] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.509291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.520257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.520965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.521166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.521428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.522063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.523439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:04.523439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:37:04.523439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:37:04.524297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6aad-28df-49c5-a4bd-7024cfd85552 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.527538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466dd4a-366f-4039-8cdd-5973a84ff2be admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.539284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.540257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.540752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.541228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.542064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.546250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.582900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 763/1550] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.584263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e85de-1751-401e-b120-3ead92214b7d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.584560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e85de-1751-401e-b120-3ead92214b7d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.584838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e85de-1751-401e-b120-3ead92214b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.603093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 788/1551] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.603944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.607367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-598e85de-1751-401e-b120-3ead92214b7d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.608564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-598e85de-1751-401e-b120-3ead92214b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.666814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fc81c-5ef4-4ddb-9d7d-21e5922e0831 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.668054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 764/1552] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.669285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7999cc-1018-491a-aa17-4ddd10150e30 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.669566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7999cc-1018-491a-aa17-4ddd10150e30 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.669834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7999cc-1018-491a-aa17-4ddd10150e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.675230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.676025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.676326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.676601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.677459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.680499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66a8ca-6d59-456c-a589-c6aa28c6ff7b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.690509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5d7999cc-1018-491a-aa17-4ddd10150e30 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.692469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5d7999cc-1018-491a-aa17-4ddd10150e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.701149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 765/1553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.702781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57636-8f6c-4a27-8422-dd49993bb91c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.703030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57636-8f6c-4a27-8422-dd49993bb91c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.703319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57636-8f6c-4a27-8422-dd49993bb91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.714724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 789/1554] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.714724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.714724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.714724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.723941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-62f57636-8f6c-4a27-8422-dd49993bb91c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.725177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-62f57636-8f6c-4a27-8422-dd49993bb91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.734621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.735883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.787335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 766/1555] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.792381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.792669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.792938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.795071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 790/1556] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.795900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.807596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b08f4-dc36-414b-b9a5-bb23b9cb140d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.812300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.812899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.813180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.813339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.813440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.814044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.814437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.815042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:04.815042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:37:04.815042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:37:04.816767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.822860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 767/1557] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.823628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.825748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.835647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526308f-b524-4ddc-839b-f2902811d8a9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.840301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.840523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 791/1558] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/users => generated 281 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.841047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.841385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.841502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.841662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.842288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.844656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd033e2-71c9-4aef-970b-c630017f20f1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.851013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f74b52-68a6-45d1-bd6f-c8b50d768c14 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.856175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.857127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.857626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.858045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.858810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:04.859271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.861208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.861579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:04.871054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 768/1559] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.871054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1f5e-9a59-4fa1-85d4-39faabc5f081 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.871054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1f5e-9a59-4fa1-85d4-39faabc5f081 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.871054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d1f5e-9a59-4fa1-85d4-39faabc5f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.876771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 792/1560] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:04.877542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.887127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e0fdb-7765-41b6-9b13-e9f5df238769 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.891789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.892370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.892648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.892904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4e6d1f5e-9a59-4fa1-85d4-39faabc5f081 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.893016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.893519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.894804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4e6d1f5e-9a59-4fa1-85d4-39faabc5f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.896270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c12cb-3c9c-4a3d-93ea-94e27458acea admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.902551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 769/1561] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.903729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054ed1d-6f0e-481c-83da-ffca9e53684a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.904314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054ed1d-6f0e-481c-83da-ffca9e53684a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.904580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054ed1d-6f0e-481c-83da-ffca9e53684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.918978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 793/1562] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:04.920135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.920422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.920698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.926533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e054ed1d-6f0e-481c-83da-ffca9e53684a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.927748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e054ed1d-6f0e-481c-83da-ffca9e53684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.935491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 770/1563] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.936643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.936919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.937192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.943121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.944346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.952409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 794/1564] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.953244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.960895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:04.962070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:04.963390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884b15b-ce00-460e-ba86-af20293f3049 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.968019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.968601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.968881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.969149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.969778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.970165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 771/1565] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:04.970826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.971407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.981672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b5452-0736-48fb-816f-b3b33194bb07 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:04.985088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 795/1566] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:04.985088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:04.987129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:04.988149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:04.988149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:04.988524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:04.989213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:04.990848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:04.996115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e03018-cfec-4156-aca5-f07f26eb8b50 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.001260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 772/1567] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.002093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.002302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.002703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.002986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.003362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.004442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.006087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.013460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97685-dfdd-4e39-bebe-a19afdf212c6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.018036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.018626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.019399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.019707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.020345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.020638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.022211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.036006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 773/1568] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.036812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.040969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 796/1569] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.040969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.048098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f1c5-c3e6-42e1-afed-456b420e2504 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.102777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b374c-9d41-406f-897c-090f6bb5bfc2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.104686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.105292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.105573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.105846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.106475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.107421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.108031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.108136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.108306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.108572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.109234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.109537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.111096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.117683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 774/1570] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.121317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.129591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 797/1571] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.129591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.131153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908117b-10aa-488b-94a9-b34fb8edd575 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.135768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.136348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.136624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.136888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.137525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.137823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.138544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb58c7d-e8b4-441c-addc-82ac40ebe0e3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.139412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.143099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.143701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.144485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.144747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.145365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:05.145658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.147209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.151961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 775/1572] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.152759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.162254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ef6c-5ffb-4d48-9fa9-d59fb0e26af3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.164454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 798/1573] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:05.165248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.167112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.167732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.168006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.168271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.169006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.170575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.175102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bf57e-0eec-46bb-b782-58db8421ea91 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.180267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.180833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.181027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 776/1574] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.181149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.181350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.181796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.182133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.183676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.191675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748deb-a1c8-4661-8996-ee8883467a7c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.196057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 799/1575] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.196057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.196711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.197294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.197597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.197865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.198466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.200378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.205336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc18f1-81ee-4517-9bd9-27d400626e74 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.209941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.210544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.211180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.212691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.212691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.214740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.222642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 777/1576] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.223558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.235772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8f3b8-1532-47ac-8c95-205445a320b0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.241408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.241996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.242278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.242572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.243280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.244815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.245197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 800/1577] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.248308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.258581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 778/1578] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.258581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.268135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68177692-b493-4a0c-8380-9590c59b6834 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.281239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.313146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdccbf3-7707-437b-a7c3-1142bd2d101d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.318715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.319390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.319717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.319994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.320629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.322564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.327491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.328101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.328400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.328649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.329271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.332745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.338110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.352404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 801/1579] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.353668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.371134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 779/1580] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.371134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.415874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f17f-4599-43a5-b309-50e8386c26df admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.430838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66cba-dbc3-475c-87eb-64e0eac79756 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.435638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.436341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.436615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.436882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] PATH_INFO: `/v3/projects/41c557724f994753b1f71cb2497e6591/users/15cab40ba8884994af242c31d6fd1636/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.451508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c557724f994753b1f71cb2497e6591, user_id=15cab40ba8884994af242c31d6fd1636, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.452535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:05.452535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:37:05.452535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:37:05.454439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.468075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 780/1581] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:05 2022] PUT /identity/v3/projects/41c557724f994753b1f71cb2497e6591/users/15cab40ba8884994af242c31d6fd1636/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:05.468769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.477987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.478879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.479183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.480098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.480742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.482656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.513719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 802/1582] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.513719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.536181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52993e78-bd1e-47dd-b952-f1ac48bd9dad admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.558152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.574967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008146b-1c99-44a2-b893-a8c11866d915 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.584297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.584903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.585187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.585464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.586105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.587787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.594732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.595435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.595715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.599089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] PATH_INFO: `/v3/projects/7e2bf24478c34b9088fb7cfaa0affb97/users/919c94bd42144c9b86fd9977e85b0762/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.599272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 803/1583] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.599272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.608753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8364e9-eb63-4a09-90d4-42a34f1ea1b6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.613863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.614454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.614729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.614994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.615641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.616720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2bf24478c34b9088fb7cfaa0affb97, user_id=919c94bd42144c9b86fd9977e85b0762, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.617535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.619429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.629220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.639864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 781/1584] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:05 2022] PUT /identity/v3/projects/7e2bf24478c34b9088fb7cfaa0affb97/users/919c94bd42144c9b86fd9977e85b0762/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:05.639864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.641481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 804/1585] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.642258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.652056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfee9ce-18f0-415c-a6bb-6f90bc7fdb6c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.704469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01719e58-e584-4d0c-b7ac-f03a9bdec314 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.709347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.709995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.710272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.710541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] PATH_INFO: `/v3/projects/9193df5e4d39448c947cfbb3139306bf/users/86090cd4247d4d598eb1976f4224b4f3/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.712827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.713439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.713710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.714009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.714656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.716620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.724664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9193df5e4d39448c947cfbb3139306bf, user_id=86090cd4247d4d598eb1976f4224b4f3, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.727227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbe0d7-e8b4-4f1e-ab53-2ef31ed68297 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.739335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 805/1586] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.740276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.742931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 782/1587] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:05 2022] PUT /identity/v3/projects/9193df5e4d39448c947cfbb3139306bf/users/86090cd4247d4d598eb1976f4224b4f3/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:05.744192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.744476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.744747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.750402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae48b2-1fd2-4a84-9cbb-c2262128a894 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.772207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] MFA Rules not processed for user `15cab40ba8884994af242c31d6fd1636`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:05.773411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:05.809348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.809956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.810236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.810504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.811126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.813072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.833855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 806/1588] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.834631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.840568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 783/1589] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:05.841396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.847127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e3953-b50b-4bbb-9b54-72f12837da17 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.851984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe93b5-5da7-46a4-99af-3ca38ff1e78f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.852153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.852734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.853010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.853274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.853881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.855873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.856803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.857381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.857779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.858049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.858703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.860315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac299b4-8fa5-4269-a944-662b52777c12 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.872059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 784/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.873431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.873718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.873992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.880808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 807/1591] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/users => generated 278 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.880808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.888258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b5c6f-5852-4968-b68b-c0b4a43a3143 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.892731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.893303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.893576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.894384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.894986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.895577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:05.896588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a77c-eacd-4937-9dfd-4f3ce71f397f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.896792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:05.904805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 785/1592] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:05.905613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.907236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 808/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.908301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.908945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.908945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.919530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9695-3c29-4be7-8171-158f483967ed None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.924326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.924997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.925806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.926075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.926709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.927398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:05.928333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.928598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:05.936062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 809/1594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:05.940403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 786/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.940681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.940869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.951220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8c133-b4f1-4e1c-a75f-379a114eb368 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.951416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5155f-c88b-4c56-9d3e-24b845bb7b20 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.956161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.956991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.957269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.957544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.957648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.957811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.957912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.958098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:05.958438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.958709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:05.960067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.960616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:05.962670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:05.973160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 810/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:05.973953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.984212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121b348-6a8c-4990-9b11-04497cc95e1d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:05.988751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:05.991866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 787/1597] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:05 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:05.991963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:05.992048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:05.992131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:05.992131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] PATH_INFO: `/v3/projects/a780800618e549c6b01ef67dd64333c4/users/d39e95dd7b6e4055842699bbc54c39f5/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.006699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a780800618e549c6b01ef67dd64333c4, user_id=d39e95dd7b6e4055842699bbc54c39f5, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.009458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.012423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:06.023895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 811/1598] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:05 2022] PUT /identity/v3/projects/a780800618e549c6b01ef67dd64333c4/users/d39e95dd7b6e4055842699bbc54c39f5/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.024961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.057764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478b9ab-1142-410a-b92b-d3681647e32d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.085727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffe678-ea5b-4843-a191-7fa7e1e18fd4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.090418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.091011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.091308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.091578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.092205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.093773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.103834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 812/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.104610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.116619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.117302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.117644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.117983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.118678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.120347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.130248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 788/1600] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.131029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.140032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61871a-817c-42ed-a6e2-a26bec28d6e8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.145199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.145762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.146039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.146305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.147280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.148477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.157897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 789/1601] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.159083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.162379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a2456-81ae-4dc7-9457-090bf1708940 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.166049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.166644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.166918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.167191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.167786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a3d4b-31c8-4b7b-95a5-2547acfbbe6e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.172365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.173061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.173477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.173815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.176648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.178069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.183052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.184490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.187400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 813/1602] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:06.188175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.197754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024932d1-d5a1-47bb-a717-a2115adf405c service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.198152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 790/1603] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:06.198934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.203669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.204254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.204531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.204796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.205798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.208303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1344302-ef56-4e11-9a2f-cd9d3d45bda3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.208615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cd9d5-31a5-45d4-9a46-7ff991c43f6c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.213710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.214299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.214684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.214916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.215469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.217403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.223057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 814/1604] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.223057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.223057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.223057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.241596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:06.242837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:06.246198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 791/1605] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:06.247142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.256892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 815/1606] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:06.256892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.263125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818c247-2a3d-488d-810e-d8907a95b172 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.268245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.270098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.270098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.270312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] PATH_INFO: `/v3/projects/3a19680e636e49f482f5108871c7a086/users/54d785f6f86f42349885701ef005ca63/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.274535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36042f-59c6-4b6a-8736-77ba6c50ab4a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.280887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.281615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.281948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.282279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.283023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.284865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.286866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a19680e636e49f482f5108871c7a086, user_id=54d785f6f86f42349885701ef005ca63, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.289484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.295891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 816/1607] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.296872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.307538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd40e7-384d-47fa-9f10-db0794d56d36 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.308237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 792/1608] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:06 2022] PUT /identity/v3/projects/3a19680e636e49f482f5108871c7a086/users/54d785f6f86f42349885701ef005ca63/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.309353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.368190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:06.389980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.390725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.391192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.391580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] PATH_INFO: `/v3/projects/1eaf417494fd445cb3b97dadef0d66fd/users/91d99054afc0400ba9f31bcb0bfa9f45/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.393059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:06.399796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06c6d-8c96-4ff4-aa4f-e2afea3a6469 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.407673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.408473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.408886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.410109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] PATH_INFO: `/v3/projects/2a036d3083bb4055a3aed77a698b2c3b/users/28a58d55f9cc42c7a041884eee0ea248/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.411489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaf417494fd445cb3b97dadef0d66fd, user_id=91d99054afc0400ba9f31bcb0bfa9f45, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.414493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.430116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a036d3083bb4055a3aed77a698b2c3b, user_id=28a58d55f9cc42c7a041884eee0ea248, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.441955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 817/1609] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:06 2022] PUT /identity/v3/projects/1eaf417494fd445cb3b97dadef0d66fd/users/91d99054afc0400ba9f31bcb0bfa9f45/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.441955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.442239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.454430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 793/1610] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:06 2022] PUT /identity/v3/projects/2a036d3083bb4055a3aed77a698b2c3b/users/28a58d55f9cc42c7a041884eee0ea248/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.455958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.460632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:06.519553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238aa83-11e1-407b-8323-fb2cf895b301 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.533288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dcef-f210-45ee-a2a6-ef05a4a0dcb7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.537303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.537949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.538184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.538567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.584798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.585492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.585766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.586034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.586730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.588425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.600448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 818/1611] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:06.601194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.615192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c0ba0-c228-4dd8-846e-c8ab73fe6333 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.619999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.620663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.620921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.621192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] PATH_INFO: `/v3/projects/c13d6d0e4a334e6395c10030359a18fb/users/6a487755cb5d499a8ec6fb1768933249/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.628463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.630840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e23dd-4bf7-49f5-bb2b-dbf9881a0fab service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.639747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13d6d0e4a334e6395c10030359a18fb, user_id=6a487755cb5d499a8ec6fb1768933249, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.643621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9b3f4-a77a-43dc-874f-77b17b32a6c4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.652843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 794/1612] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:06.655219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4c32-a051-4a51-a77b-7b82435e9bf0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.655633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4c32-a051-4a51-a77b-7b82435e9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.655843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab4c32-a051-4a51-a77b-7b82435e9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.672506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 819/1613] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:06 2022] PUT /identity/v3/projects/c13d6d0e4a334e6395c10030359a18fb/users/6a487755cb5d499a8ec6fb1768933249/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.684956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.685242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.685518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.716181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-20ab4c32-a051-4a51-a77b-7b82435e9bf0 None None] MFA Rules not processed for user `54d785f6f86f42349885701ef005ca63`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:06.717483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-20ab4c32-a051-4a51-a77b-7b82435e9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:06.723181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] MFA Rules not processed for user `91d99054afc0400ba9f31bcb0bfa9f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:06.724513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:06.765533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:06.809279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 795/1614] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:06.810816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9178d3-2574-43cf-ad80-216dd8db9978 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.811200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9178d3-2574-43cf-ad80-216dd8db9978 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.812242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9178d3-2574-43cf-ad80-216dd8db9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.834225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 820/1615] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:06.834225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.843544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6b9178d3-2574-43cf-ad80-216dd8db9978 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:06.845792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6b9178d3-2574-43cf-ad80-216dd8db9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:06.870948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:06.920921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c44c6-c618-4b1d-b2f3-64176a3b720a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:06.927971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:06.929003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.929455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.929702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] PATH_INFO: `/v3/projects/5998ec330df047658b9e33b456a083d1/users/3ad6dfc98a2a48af96b44a833bb03f92/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.939801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 796/1616] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:06.941841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:06.942293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:06.942700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:06.949024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5998ec330df047658b9e33b456a083d1, user_id=3ad6dfc98a2a48af96b44a833bb03f92, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:06.954860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:06.979797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 821/1617] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:06 2022] PUT /identity/v3/projects/5998ec330df047658b9e33b456a083d1/users/3ad6dfc98a2a48af96b44a833bb03f92/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:06.980927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:06.984037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] MFA Rules not processed for user `6a487755cb5d499a8ec6fb1768933249`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:06.985366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:07.064195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb154727-840a-4ed8-b1b5-d3479c8f9bd3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.072040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.072950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.073392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.076225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 797/1618] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:07.076225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.089352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.160500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.162262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.166093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140976c-35de-41d5-98ef-2963a3c92c81 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.173810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 822/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:07.175811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.188232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2026629-fb23-43b1-8d73-829b6b8d2603 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.188777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.189918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.190856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.191201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.193069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.193852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.194593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.194967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.195526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.196274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.198098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.200090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.210844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 823/1620] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:07.211941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.217769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:07.224396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15568-5853-4742-8d30-12e294d910b7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.231888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.233207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.233487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.233782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.236121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.239017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.251980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 798/1621] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:07.256542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.309977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 824/1622] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:07.310523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.352270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:07.398093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41a8d2-ef41-4db8-8329-b343b34dda9c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.466693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845af37-75d9-4694-946d-cd230cdbb6ac admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.480388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.482545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.484898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.485193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] PATH_INFO: `/v3/projects/5998ec330df047658b9e33b456a083d1/users/3ad6dfc98a2a48af96b44a833bb03f92/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.490544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5998ec330df047658b9e33b456a083d1, user_id=3ad6dfc98a2a48af96b44a833bb03f92, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.499094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.533118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 825/1623] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:07 2022] PUT /identity/v3/projects/5998ec330df047658b9e33b456a083d1/users/3ad6dfc98a2a48af96b44a833bb03f92/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:07.533118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.558929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.560111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.560397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.560672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.590259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.593802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.621659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 799/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:07.622586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.651460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e7249-db1b-49d9-8d57-3921afa7c962 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.695653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1c44-bb1e-4b92-8cc5-252b4ff68dc3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.708975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.710762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.711129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.711789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.712912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.715092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c13de-39d1-4a86-9e5d-c289237aaa2a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.786958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 826/1625] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:07.790851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.792244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.792799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.822076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.822808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.823101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.823396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.824035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.829367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.861265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] MFA Rules not processed for user `3ad6dfc98a2a48af96b44a833bb03f92`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:07.863198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:07.874604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 800/1626] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:07.877672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.911054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1585f-5685-412e-8821-f404fb39371c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.926385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.927324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.927461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:07.927630 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:07.928274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:07.932471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:07.957420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 801/1627] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:07.963803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:07.986099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b583-9174-4cf7-a901-b5a1b7c5a732 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:07.997139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:07.998090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:07.998462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.001550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.001550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.002288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.003140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.033808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 802/1628] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:08.035385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.043123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 827/1629] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:08.045179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.058759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e872b8-7998-47d2-a42d-631fba9354f9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.068551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9c07-c195-4fa7-89df-a51ca8784de2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.069810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.070897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.071176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.071473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] PATH_INFO: `/v3/projects/5705122f2779484b8fc0ff8becb16267/users/9a595a6da3864ffabce8590ca00099cf/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.078883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.079420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.079794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.079978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] PATH_INFO: `/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b/users/ae63da57dd6a4f97b970df3a01fca4a5/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.104572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5705122f2779484b8fc0ff8becb16267, user_id=9a595a6da3864ffabce8590ca00099cf, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.108514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.115313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0eb65a757e4d2984046abb5b17dd3b, user_id=ae63da57dd6a4f97b970df3a01fca4a5, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.120799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.145287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 803/1630] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:08 2022] PUT /identity/v3/projects/5705122f2779484b8fc0ff8becb16267/users/9a595a6da3864ffabce8590ca00099cf/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:08.152421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.168263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 828/1631] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:08 2022] PUT /identity/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b/users/ae63da57dd6a4f97b970df3a01fca4a5/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:08.169827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.305373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.337633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b43d-224d-4686-9a17-543335fdd372 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.384955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b077-b8c5-4399-8dab-78b50de4098f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.392275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.393388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.393960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.394409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.395420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.398493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.416525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.416525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.416525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.416525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.417983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 829/1632] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:08.419182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.434603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7978739-f3f7-4a92-aeef-21abc580f871 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.441861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.443225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.443719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.444152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.445929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.448630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.468322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 830/1633] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:08.469212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.483656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2224df1-6049-48f2-98b3-6c629fcafbca admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.490957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.492309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.492309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.492804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] PATH_INFO: `/v3/projects/5705122f2779484b8fc0ff8becb16267/users/9a595a6da3864ffabce8590ca00099cf/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.495038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5705122f2779484b8fc0ff8becb16267, user_id=9a595a6da3864ffabce8590ca00099cf, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.499733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.508526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.510443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74787c-3b3e-4040-9ed0-52ede1fab657 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.514671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 831/1634] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:08 2022] PUT /identity/v3/projects/5705122f2779484b8fc0ff8becb16267/users/9a595a6da3864ffabce8590ca00099cf/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:08.515949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.523950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 804/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:08.527022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.527576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.528128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.571152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] MFA Rules not processed for user `9a595a6da3864ffabce8590ca00099cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:08.572761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:08.678202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57b10f-18ce-4c5c-bfa1-731be90264a8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.684613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.685386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.685734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.686135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] PATH_INFO: `/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b/users/ae63da57dd6a4f97b970df3a01fca4a5/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.688834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0eb65a757e4d2984046abb5b17dd3b, user_id=ae63da57dd6a4f97b970df3a01fca4a5, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:08.692876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13444-5694-43b9-8210-cdb9d3aec6f0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:08.699739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 805/1636] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:08.708555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 832/1637] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:08 2022] PUT /identity/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b/users/ae63da57dd6a4f97b970df3a01fca4a5/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:08.710422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:08.731505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.731789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.733171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:08.804331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.811050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] MFA Rules not processed for user `ae63da57dd6a4f97b970df3a01fca4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:08.818694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:08.868112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf5e5d-0b09-43a9-a88a-9952fd26a25f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:08.881266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:08.940125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:08.941689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:08.942107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:08.942379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:09.042356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:09.044601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:09.062433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 806/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:09.081405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 833/1639] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:09.119404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:09.130167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b1178-8d80-4994-96cc-27887a85d954 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:09.133462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:09.134715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:09.135002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:09.135354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:09.150726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:09.152766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:09.168142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 807/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:09.275798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:09.290277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c36161-b34b-476a-af08-fc7b1a092204 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:09.295484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:09.296645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:09.297090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:09.297512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:09.366454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:09.368656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:09.380046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:09.381298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 834/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:09.399581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c594-528d-4a9e-9784-76ddcaba9bee service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:09.405938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:09.406561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:09.406838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:09.407108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:09.504981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:09.506765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bedbb8-9cdc-4228-a4e5-02d6bc2fee45 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:09.518013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 808/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:10.151778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.256868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80c653-8a8e-4988-9d58-c09bce050ea3 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:10.268165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:10.269916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.269916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.270209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] PATH_INFO: `/v3/users/15cab40ba8884994af242c31d6fd1636` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.273758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cab40ba8884994af242c31d6fd1636)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:10.280312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:10.315522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908544f-34fa-4e5b-97d5-272a1a4272a7 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.316394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908544f-34fa-4e5b-97d5-272a1a4272a7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.316732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908544f-34fa-4e5b-97d5-272a1a4272a7 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.318499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 809/1643] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:10.333244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4863-b82d-4704-a72e-cb13a3c204aa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.333560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4863-b82d-4704-a72e-cb13a3c204aa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.334007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad4863-b82d-4704-a72e-cb13a3c204aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.431934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cab40ba8884994af242c31d6fd1636'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:10.432091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.438811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b3ad4863-b82d-4704-a72e-cb13a3c204aa None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:10.441957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b3ad4863-b82d-4704-a72e-cb13a3c204aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:10.466246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cab40ba8884994af242c31d6fd1636'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:10.472559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:10.495329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cab40ba8884994af242c31d6fd1636'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:10.501436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cab40ba8884994af242c31d6fd1636'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:10.540441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a09c264-8924-48fc-a1b0-739b785794ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cab40ba8884994af242c31d6fd1636'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:10.567814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 835/1644] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:10 2022] DELETE /identity/v3/users/15cab40ba8884994af242c31d6fd1636 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:10.569705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.569960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.570236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.609889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:10.611136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:10.637175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 810/1645] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:10.638619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b82446-6fb4-4455-a5f2-4ab93a37ed99 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.638987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b82446-6fb4-4455-a5f2-4ab93a37ed99 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.639284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b82446-6fb4-4455-a5f2-4ab93a37ed99 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.640644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 811/1646] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:10.648068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:10.648068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:10.648377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:10.707870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:10.709371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:10.759393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 836/1647] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:10.863862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.866684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:10.887657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 812/1648] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:10.903413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:10.906848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:11.015218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629456-2c2a-4b69-8e26-70476c5f0a83 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.034785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.038477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.039027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.043191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.074326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.077613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:11.096700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 837/1649] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:11.118411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bbfba-f4b0-4e6c-bc22-ce1ef25c7b51 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:11.126222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:11.126867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:11.127149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:11.127495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:11.160995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:11.166498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:11.193399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 813/1650] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:12.502027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:12.505416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:12.541526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a5270-dcc3-4875-8e92-436b6397b1ec service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:12.563096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:12.564178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:12.564563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:12.565235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] PATH_INFO: `/v3/projects/41c557724f994753b1f71cb2497e6591` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:12.569541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c557724f994753b1f71cb2497e6591)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:12.570759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: WARNING py.warnings [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:12.570759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: warnings.warn(msg) Aug 06 20:37:12.570759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: Aug 06 20:37:12.573919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:12.818648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c557724f994753b1f71cb2497e6591', 'request_id': 'req-dba3129b-83d1-4784-8221-99780ee30dbd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:12.840489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c557724f994753b1f71cb2497e6591', 'request_id': 'req-dba3129b-83d1-4784-8221-99780ee30dbd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:12.905401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c557724f994753b1f71cb2497e6591', 'request_id': 'req-dba3129b-83d1-4784-8221-99780ee30dbd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:12.971490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:12.980098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] The token cache is being invalidate because project 41c557724f994753b1f71cb2497e6591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:12.982177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:12.984816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:12.994126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 838/1651] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:12 2022] DELETE /identity/v3/projects/41c557724f994753b1f71cb2497e6591 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:12.994983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:13.011477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434dba5-939a-4969-810d-0addd85b660a service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:13.085866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:13.147157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:13.148569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:13.148923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:13.149278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] PATH_INFO: `/v3/users/3ad6dfc98a2a48af96b44a833bb03f92` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:13.151325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad6dfc98a2a48af96b44a833bb03f92)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:13.152557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: WARNING py.warnings [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 20:37:13.152557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: warnings.warn(msg) Aug 06 20:37:13.152557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: Aug 06 20:37:13.155323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:13.304458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad6dfc98a2a48af96b44a833bb03f92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:13.324483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad6dfc98a2a48af96b44a833bb03f92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:13.344998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad6dfc98a2a48af96b44a833bb03f92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:13.393493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad6dfc98a2a48af96b44a833bb03f92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:13.395450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7de3b426-0bab-4c46-967b-1d1e923bb29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad6dfc98a2a48af96b44a833bb03f92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:13.411856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 814/1652] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:12 2022] DELETE /identity/v3/users/3ad6dfc98a2a48af96b44a833bb03f92 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:13.994773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:13.996297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:14.019074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3129b-83d1-4784-8221-99780ee30dbd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.170292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.171547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.171984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.172407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] PATH_INFO: `/v3/projects/5998ec330df047658b9e33b456a083d1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.174231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5998ec330df047658b9e33b456a083d1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.178374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.266015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5998ec330df047658b9e33b456a083d1', 'request_id': 'req-ca6ee141-1f4b-4359-8c21-d99113562dfd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:14.276540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5998ec330df047658b9e33b456a083d1', 'request_id': 'req-ca6ee141-1f4b-4359-8c21-d99113562dfd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:14.295012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5998ec330df047658b9e33b456a083d1', 'request_id': 'req-ca6ee141-1f4b-4359-8c21-d99113562dfd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:14.320146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] The token cache is being invalidate because project 5998ec330df047658b9e33b456a083d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:14.320375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:14.321567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca6ee141-1f4b-4359-8c21-d99113562dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:14.323993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 839/1653] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:13 2022] DELETE /identity/v3/projects/5998ec330df047658b9e33b456a083d1 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:14.329043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.329934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.329934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.367750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:14.369445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:14.521319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 815/1654] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:14.522998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.523586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.524162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.612949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:14.616540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:14.644521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 840/1655] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:14.649348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.679195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4046-be52-487e-8433-e5d5937467f1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.694853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.696813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.696813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.697023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.697680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:14.697963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.699617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.753472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 816/1656] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:14.755068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.770088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d81f34-bcb0-4931-b40a-61a09e3d499d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:14.787220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:14.787905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:14.788182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:14.788540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:14.794893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:14.801535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85878364-baf7-4f1b-8ef3-02cec9763b21 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:14.936782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 841/1657] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:14.938534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:14.960529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee067f-ce4b-40de-8f35-f231420032b9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:15.125275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:15.183750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:15.184393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.184676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.184948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.185606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:15.192403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6d65c-1f2f-4183-b5a3-3ca5a364d6f1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:15.270586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a97e-f7c3-4fcc-b8a8-b495ff542193 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.271638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a97e-f7c3-4fcc-b8a8-b495ff542193 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.272071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a97e-f7c3-4fcc-b8a8-b495ff542193 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.273910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 842/1658] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 20:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:15.274517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 817/1659] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:14 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:15.280570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a97e-f7c3-4fcc-b8a8-b495ff542193 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:15.301588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f43df-e511-4891-b017-ebb55fa4ae7e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.302109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f43df-e511-4891-b017-ebb55fa4ae7e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.302738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f43df-e511-4891-b017-ebb55fa4ae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.319312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a97e-f7c3-4fcc-b8a8-b495ff542193 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:15.336072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:15.336697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.336982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.337252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.337902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:15.350016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:15.373134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9e4f43df-e511-4891-b017-ebb55fa4ae7e None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:15.381164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9e4f43df-e511-4891-b017-ebb55fa4ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:15.410030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 843/1660] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:15.415097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:15.450678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5e05c-7ab2-4683-8fe5-9693b6860a43 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:15.479227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:15.479878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.480859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.480859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.481034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:15.498676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:15.523710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 844/1661] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:15.524638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:15.545174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674753-a3b1-4e86-be85-a04a83eb148f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:15.558314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:15.558984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.559291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.559549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] PATH_INFO: `/v3/projects/f7759f6b8621410ebcc53b369fe2eb64/users/06239807ace64b03820682516009ca69/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.608011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 818/1662] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:15.626469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233c03-5754-41c1-b2d3-caa270ebd81a None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.627805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7759f6b8621410ebcc53b369fe2eb64, user_id=06239807ace64b03820682516009ca69, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:15.628385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233c03-5754-41c1-b2d3-caa270ebd81a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.628805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2233c03-5754-41c1-b2d3-caa270ebd81a None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.632902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 819/1663] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 20:37:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:15.633450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06032-98a5-4372-838b-3476e77dbdc0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:15.655394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.658744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.659270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.672636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 845/1664] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:15 2022] PUT /identity/v3/projects/f7759f6b8621410ebcc53b369fe2eb64/users/06239807ace64b03820682516009ca69/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:15.683386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:15.683942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:15.684350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:15.721858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:15.731340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:15.784786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] MFA Rules not processed for user `06239807ace64b03820682516009ca69`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:15.786036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:15.793680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:15.919027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 820/1665] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:15.956672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 846/1666] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:15.958941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:15.982152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:15.983971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:16.122710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:16.149194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6d37b-5a3a-42b8-a096-81db67323388 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.161314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.161944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.162224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.162496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.163144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.165125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.170329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cd801-8602-4a02-a92a-9352bd02f412 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.180677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.181317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.181596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.181867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.208365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.211088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.244987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 821/1667] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:15 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:16.246268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.251477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 847/1668] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:16.450052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2628a-d27f-4ac5-9116-7e10d42ef29e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.461243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.463490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.463932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.464946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.466300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.469799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.513514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 822/1669] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:16 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:16.517171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.532968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe05a-6a12-40fd-8184-431a314b8eb2 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.544916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.545554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.545836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.546106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.547004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.548647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.574065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 848/1670] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:16.582681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.595429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaeb5b-6dbb-46b7-9d43-b6dd809bcd0a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.618333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.619471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.619909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.620682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] PATH_INFO: `/v3/projects/ecf7bf96c02f424eb7cf16644df9886b/users/44513b19ae5e4cd98350eb004507f787/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.652177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf7bf96c02f424eb7cf16644df9886b, user_id=44513b19ae5e4cd98350eb004507f787, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.655674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.684094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 823/1671] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:16 2022] PUT /identity/v3/projects/ecf7bf96c02f424eb7cf16644df9886b/users/44513b19ae5e4cd98350eb004507f787/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:16.687851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.698780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac83c3-7860-4f3c-9bcd-2efff908380b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.854494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.855298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.855593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.855869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.856527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.858147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9c311-e495-4ef9-98d0-a5d8a7b6c24e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.877280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 849/1672] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:16.881402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:16.900565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6782-22f8-41d5-8a55-0269bb771edf admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:16.913684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:16.914526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.914651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.914887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] PATH_INFO: `/v3/projects/ecf7bf96c02f424eb7cf16644df9886b/users/44513b19ae5e4cd98350eb004507f787/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:16.921748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf7bf96c02f424eb7cf16644df9886b, user_id=44513b19ae5e4cd98350eb004507f787, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:16.925270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:16.949566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 824/1673] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:16 2022] PUT /identity/v3/projects/ecf7bf96c02f424eb7cf16644df9886b/users/44513b19ae5e4cd98350eb004507f787/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:16.960185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f812d-fffd-497b-aa85-e4a6985a6b32 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:16.960476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f812d-fffd-497b-aa85-e4a6985a6b32 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:16.960758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f812d-fffd-497b-aa85-e4a6985a6b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.027536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a28f812d-fffd-497b-aa85-e4a6985a6b32 None None] MFA Rules not processed for user `44513b19ae5e4cd98350eb004507f787`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:17.028994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a28f812d-fffd-497b-aa85-e4a6985a6b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.111296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:17.223768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 850/1674] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:17.239081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:17.241924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.277372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495ef1-cc21-45d5-b09a-bfa03b6dd69a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.277669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495ef1-cc21-45d5-b09a-bfa03b6dd69a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.277987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495ef1-cc21-45d5-b09a-bfa03b6dd69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.347480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b9495ef1-cc21-45d5-b09a-bfa03b6dd69a None None] MFA Rules not processed for user `d39e95dd7b6e4055842699bbc54c39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:17.348871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9495ef1-cc21-45d5-b09a-bfa03b6dd69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.375579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79762303-46f3-4be6-a700-aeea6eafec72 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:17.380495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:17.381235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.381564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.381836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.397150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:17.398801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:17.410994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 825/1675] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:17.441333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:17.457814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 851/1676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:17.468841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.469587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.470789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.480636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:17.506565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] MFA Rules not processed for user `d39e95dd7b6e4055842699bbc54c39f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:17.507937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.532456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340a164-0c2e-42ce-b6ee-4adb7814a261 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:17.541038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:17.542581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.544576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.545137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] PATH_INFO: `/v3/users/06239807ace64b03820682516009ca69` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.547379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06239807ace64b03820682516009ca69)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:17.551187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:17.557456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 852/1677] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:17.559433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:17.574281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.650599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06239807ace64b03820682516009ca69'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:17.664305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06239807ace64b03820682516009ca69'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:17.678588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06239807ace64b03820682516009ca69'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:17.702201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06239807ace64b03820682516009ca69'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:17.703476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f1cb79b4-df88-4b45-a2c9-1dfcf02be069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06239807ace64b03820682516009ca69'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:17.711574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 826/1678] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:17 2022] DELETE /identity/v3/users/06239807ace64b03820682516009ca69 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:17.716928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.719088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.723902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.781952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:17.783179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.826286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6683f-7143-4cd3-9a99-e6760fde0b4d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:17.909652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:17.954764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 827/1679] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:17.966020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:17.967460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:17.967875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:17.968222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:17.969991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:17.990825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:17.993874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:18.110322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:18.113930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de30a-6d77-4a04-9fae-5d3b2fb87760 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:18.120264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568665d7-e1a1-45eb-9cf3-765eac1f814f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:18.130519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:18.131698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:18.132230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:18.132828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:18.133313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 853/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:18.189655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:18.191693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ed66f-09c5-429c-a39b-dfc0efc4a702 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:18.201647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:18.232747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 828/1681] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:18.856009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:18.856549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:18.856549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:18.858134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 854/1682] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:18.882358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:18.883130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:18.883876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:18.949199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:18.950748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:18.973010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 829/1683] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:37:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:18.981075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:18.985383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:19.031613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e5fd-a72c-45a2-a332-41174a21d97c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.040256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.040904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.041183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.041454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.058435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.060627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:19.080898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 855/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:19.894216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:19.896123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:19.919858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f453d8-8fbe-4d4a-9ad3-c521e2d5ad98 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:19.943321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:19.944438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:19.944608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:19.945045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] PATH_INFO: `/v3/projects/f7759f6b8621410ebcc53b369fe2eb64` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:19.947659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7759f6b8621410ebcc53b369fe2eb64)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:19.956039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:20.115479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7759f6b8621410ebcc53b369fe2eb64', 'request_id': 'req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.145402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7759f6b8621410ebcc53b369fe2eb64', 'request_id': 'req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.158752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7759f6b8621410ebcc53b369fe2eb64', 'request_id': 'req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.192058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] The token cache is being invalidate because project f7759f6b8621410ebcc53b369fe2eb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:20.192353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.193416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.196198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 830/1685] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:19 2022] DELETE /identity/v3/projects/f7759f6b8621410ebcc53b369fe2eb64 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:20.199981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:20.239763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394a55-f1ad-4f45-a55e-4eb6bff83b15 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:20.339603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:20.341246 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:20.474437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:20.475381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:20.478708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:20.479190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] PATH_INFO: `/v3/users/44513b19ae5e4cd98350eb004507f787` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:20.484011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44513b19ae5e4cd98350eb004507f787)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:20.486227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:20.579576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd782e-abef-4d9a-8984-c6eaa03a0ddb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:20.588917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44513b19ae5e4cd98350eb004507f787'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.594495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:20.595226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:20.604117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:20.604286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44513b19ae5e4cd98350eb004507f787'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.604417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:20.606726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:20.623666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:20.625692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b322b-92ec-47ac-bd92-64cce9d57f6e service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:20.635403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44513b19ae5e4cd98350eb004507f787'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.636050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44513b19ae5e4cd98350eb004507f787'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.638773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:20.676023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44513b19ae5e4cd98350eb004507f787'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:20.688451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 831/1686] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:20.694042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 856/1687] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:20 2022] DELETE /identity/v3/users/44513b19ae5e4cd98350eb004507f787 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:21.305267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:21.309458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:21.309919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:21.385379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] MFA Rules not processed for user `86090cd4247d4d598eb1976f4224b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:21.387101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:21.521915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:21.630743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 832/1688] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:21.647641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:21.649232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:21.801649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:21.803097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:21.925367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b62a7-162d-4782-9a0d-3c03e65def4f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:21.934915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:21.935943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:21.936060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:21.936552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:21.953942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:21.965719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efc18e-e935-4c97-a9aa-251827429948 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:21.982466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 857/1689] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:22.062400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6b4e-c0d4-445f-b3a7-2e3e3c32a9b6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:22.126739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:22.127169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:22.136975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:22.137304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] PATH_INFO: `/v3/projects/ecf7bf96c02f424eb7cf16644df9886b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:22.142834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf7bf96c02f424eb7cf16644df9886b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:22.150304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:22.298588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf7bf96c02f424eb7cf16644df9886b', 'request_id': 'req-51c88613-0a91-4004-8ac9-467e93c2d7bc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:22.308616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf7bf96c02f424eb7cf16644df9886b', 'request_id': 'req-51c88613-0a91-4004-8ac9-467e93c2d7bc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:22.329178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf7bf96c02f424eb7cf16644df9886b', 'request_id': 'req-51c88613-0a91-4004-8ac9-467e93c2d7bc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:22.374661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] The token cache is being invalidate because project ecf7bf96c02f424eb7cf16644df9886b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:22.375059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:22.376703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-51c88613-0a91-4004-8ac9-467e93c2d7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:22.383513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 833/1690] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:21 2022] DELETE /identity/v3/projects/ecf7bf96c02f424eb7cf16644df9886b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:22.385349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:22.385724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:22.386052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:22.417637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:22.419527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:22.617208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 858/1691] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:22.626199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:22.626485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:22.626898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:22.720913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:22.724729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:22.761914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 834/1692] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:22.766232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:22.778051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536923c-3600-4cb1-8d1a-b1c268819767 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:22.802611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:22.803469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:22.803822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:22.804166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:22.804899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:22.806718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:22.809164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:22.862994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 859/1693] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:22.867541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:22.878293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df674a69-5fa9-42dc-aef6-3c00e1f850a4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:22.905605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:22.906323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:22.906676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:22.907023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:22.907750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:22.910323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:23.013265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 835/1694] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:22 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:23.017386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:23.041211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272d48-b188-483f-8204-a8976fe2b97c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:23.185482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:23.200004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:23.200636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:23.200917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:23.201189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:23.201980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:23.204026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:23.286285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:23.288583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 860/1695] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:23 2022] POST /identity/v3/users => generated 294 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:23.297492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f66c34-6ad1-40f2-b7ff-2b2a814a47fb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:23.339767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:23.348866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:23.349275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:23.349562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:23.350274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:23.356641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:23.405651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 836/1696] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:23.409901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:23.433383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d502-8d35-4a26-ab87-db34b58d22a3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:23.456744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:23.457456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:23.457845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:23.463227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:23.463599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:23.465337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51040465-8047-4a9a-a9d6-e3f55b57a7ca admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:23.518652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:23.533284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 861/1697] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:23.553684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416561b-6b92-4a10-a0f4-e9b9bb2f8943 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:23.591674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:23.592541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:23.592831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:23.593161 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] PATH_INFO: `/v3/projects/c7ea255319d84c608c45bf4b1711ba35/users/e6a603ec6c414c9c8ebc5d34eb07e107/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:23.672586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ea255319d84c608c45bf4b1711ba35, user_id=e6a603ec6c414c9c8ebc5d34eb07e107, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:23.678528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:23.717587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 837/1698] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:23 2022] PUT /identity/v3/projects/c7ea255319d84c608c45bf4b1711ba35/users/e6a603ec6c414c9c8ebc5d34eb07e107/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:23.728425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:23.728715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:23.729035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:23.878730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] MFA Rules not processed for user `e6a603ec6c414c9c8ebc5d34eb07e107`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:23.891757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:24.080376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 862/1699] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:24.084815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:24.090508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:24.226389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a7c3a-9e85-41c5-b52a-260308725d71 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:24.250836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:24.251497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.251777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.252051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.252721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:24.254646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05176279-31b4-4327-b11b-98628836f3c6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:24.351298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 838/1700] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:24 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:24.351981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:24.369711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d8ed-ac3d-47c6-b72f-e5d56df82604 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:24.541626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fd2a-7341-48b2-8d78-f5cd33128ddf None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.543218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fd2a-7341-48b2-8d78-f5cd33128ddf None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.543527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23fd2a-7341-48b2-8d78-f5cd33128ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.587659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:24.590119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.590411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.590683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.600380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:24.610814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:24.665775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bd23fd2a-7341-48b2-8d78-f5cd33128ddf None None] MFA Rules not processed for user `919c94bd42144c9b86fd9977e85b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:24.669712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bd23fd2a-7341-48b2-8d78-f5cd33128ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:24.695170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 863/1701] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:24 2022] POST /identity/v3/users => generated 299 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:24.698525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:24.744055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522951-250a-40de-a4a1-175b6e423f0c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:24.757952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:24.760799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.761208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.761493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.762835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:24.770506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:24.841006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 864/1702] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:24.842004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:24.898348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab10c4-f9ff-432f-ab1a-b60cd33b6cf1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:24.920821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:24.921507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.921784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.922053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] PATH_INFO: `/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9/users/a1b8f681fa0d4e9b8675b81dce895257/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.961164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 839/1703] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:24.971960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d536-a4e7-4abd-b06e-dd1554eccad2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:24.972323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d536-a4e7-4abd-b06e-dd1554eccad2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:24.972677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d536-a4e7-4abd-b06e-dd1554eccad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:24.992229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1cefda23b9409c9e7b5063c4f7c1e9, user_id=a1b8f681fa0d4e9b8675b81dce895257, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:25.000480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:25.040368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 865/1704] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:24 2022] PUT /identity/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9/users/a1b8f681fa0d4e9b8675b81dce895257/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:25.064848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:25.081202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c9a1d536-a4e7-4abd-b06e-dd1554eccad2 None None] MFA Rules not processed for user `919c94bd42144c9b86fd9977e85b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:25.083651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c9a1d536-a4e7-4abd-b06e-dd1554eccad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:25.136440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:25.305621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f9ac-5d3f-4550-8bfa-02c6f828a277 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:25.309135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 840/1705] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:25.310546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc4ed-a03f-489e-ba4d-642021077084 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.310779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc4ed-a03f-489e-ba4d-642021077084 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.311058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768dc4ed-a03f-489e-ba4d-642021077084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.327433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:25.328290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.328645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.328989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.329728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:25.332577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:25.349996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 866/1706] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:25.355045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:25.357390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:25.438538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:25.513710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-768dc4ed-a03f-489e-ba4d-642021077084 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:25.515071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-768dc4ed-a03f-489e-ba4d-642021077084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:25.517686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfb6e3-3774-4b8c-b74a-48b3ded99771 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:25.539298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:25.539948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.540292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.540675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.553078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:25.557043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:25.599684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 867/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:25.603549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:25.640946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe3d7-a2d5-41c2-b8b9-d4e3937c1ad0 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:25.663969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:25.663969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.664205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.664465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] PATH_INFO: `/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9/users/a1b8f681fa0d4e9b8675b81dce895257/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.669195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1cefda23b9409c9e7b5063c4f7c1e9, user_id=a1b8f681fa0d4e9b8675b81dce895257, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:25.676674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa36bc-017d-41ce-9c81-7ae060369b3e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:25.730117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 868/1708] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:25 2022] PUT /identity/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9/users/a1b8f681fa0d4e9b8675b81dce895257/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:25.739467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.739759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.740038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:25.744400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 841/1709] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:25.836266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] MFA Rules not processed for user `a1b8f681fa0d4e9b8675b81dce895257`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:25.837961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:25.996454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:25.997073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:25.997520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.043585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] MFA Rules not processed for user `28a58d55f9cc42c7a041884eee0ea248`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:26.044870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:26.051467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 869/1710] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:26.063369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:26.066259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:26.107625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:26.176833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 842/1711] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:26.189437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:26.191880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:26.273330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279cb66-7c1e-405b-a5be-87a0ea33ab29 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:26.281482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:26.282342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:26.282735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:26.283133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.310016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ab2b9-345c-44fc-b5dd-db7c0505921c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:26.316602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:26.317234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:26.317518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:26.317790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.336726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:26.338417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:26.361018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 843/1712] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:26.362767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:26.378349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:26.429353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:26.433397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:26.450781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:26.474031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 870/1713] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:37:26.656278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966bea-2bd9-456a-b005-ffbd9b713775 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:26.678175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:26.678768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:26.679598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:26.680174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:26.683305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:26.732254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:26.740820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229dc44-d3a8-4a39-b157-9a667c672756 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:26.813855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 844/1714] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:26.975268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6777c-6972-4773-9012-fe756033e505 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:27.009237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:27.009923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:27.010185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:27.010652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] PATH_INFO: `/v3/users/e6a603ec6c414c9c8ebc5d34eb07e107` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:27.013674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a603ec6c414c9c8ebc5d34eb07e107)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:27.022474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:27.153094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:27.194606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a603ec6c414c9c8ebc5d34eb07e107'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:27.216352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a603ec6c414c9c8ebc5d34eb07e107'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:27.241627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a603ec6c414c9c8ebc5d34eb07e107'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:27.247098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a603ec6c414c9c8ebc5d34eb07e107'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:27.323925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a603ec6c414c9c8ebc5d34eb07e107'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:27.350443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 871/1715] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:26 2022] DELETE /identity/v3/users/e6a603ec6c414c9c8ebc5d34eb07e107 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:27.354770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:27.355224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:27.355781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:27.421258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:27.425214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:27.766284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 845/1716] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:27.777976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:27.780044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:27.949866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53592719-ccee-4399-bc21-158fd3a148f3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:27.953942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:27.954568 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:27.954843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:27.955455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:27.976874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:27.978339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:27.999307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 872/1717] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:28.877623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:28.880298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:28.918213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe754a-b798-44ba-8bb1-a417d9c13e88 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:28.943660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:28.944743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:28.945555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:28.947314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] PATH_INFO: `/v3/projects/c7ea255319d84c608c45bf4b1711ba35` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:28.949963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ea255319d84c608c45bf4b1711ba35)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:28.952646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:29.147294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ea255319d84c608c45bf4b1711ba35', 'request_id': 'req-a262de33-d12a-48e9-a805-ec89708628fc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.228731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ea255319d84c608c45bf4b1711ba35', 'request_id': 'req-a262de33-d12a-48e9-a805-ec89708628fc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.282071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ea255319d84c608c45bf4b1711ba35', 'request_id': 'req-a262de33-d12a-48e9-a805-ec89708628fc'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.364010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] The token cache is being invalidate because project c7ea255319d84c608c45bf4b1711ba35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:29.376716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.382940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.391147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 846/1718] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:28 2022] DELETE /identity/v3/projects/c7ea255319d84c608c45bf4b1711ba35 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:29.396197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:29.416938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5380401-72e6-412d-b113-424985fafb4b service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:29.685122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:29.687459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:29.687977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:29.689779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] PATH_INFO: `/v3/users/a1b8f681fa0d4e9b8675b81dce895257` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:29.697502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b8f681fa0d4e9b8675b81dce895257)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:29.708722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:29.847537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:29.849637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:29.895628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262de33-d12a-48e9-a805-ec89708628fc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:29.917638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:29.918325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:29.918651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:29.918940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] PATH_INFO: `/v3/users/91d99054afc0400ba9f31bcb0bfa9f45` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:29.944677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b8f681fa0d4e9b8675b81dce895257'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.950977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d99054afc0400ba9f31bcb0bfa9f45)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:29.959155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:29.974078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b8f681fa0d4e9b8675b81dce895257'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:29.982302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:30.003471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b8f681fa0d4e9b8675b81dce895257'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.005906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b8f681fa0d4e9b8675b81dce895257'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.051858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ef3d8301-28b7-408d-ada3-8530224e1ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b8f681fa0d4e9b8675b81dce895257'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.070406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 873/1719] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:29 2022] DELETE /identity/v3/users/a1b8f681fa0d4e9b8675b81dce895257 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:30.103748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:30.161208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d99054afc0400ba9f31bcb0bfa9f45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.180587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d99054afc0400ba9f31bcb0bfa9f45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.217876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d99054afc0400ba9f31bcb0bfa9f45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.265820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d99054afc0400ba9f31bcb0bfa9f45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.267866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d99054afc0400ba9f31bcb0bfa9f45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:30.310341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 847/1720] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:29 2022] DELETE /identity/v3/users/91d99054afc0400ba9f31bcb0bfa9f45 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:30.315092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.315514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.315872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.387382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:30.388629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:30.559662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 874/1721] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:30.747508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:30.749017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:30.818178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:30.820491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:30.851082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c740943-8eb3-47b8-b53e-cb32f08a467e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:30.867127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:30.868294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.869307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.873740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] PATH_INFO: `/v3/users/54d785f6f86f42349885701ef005ca63` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.878709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d785f6f86f42349885701ef005ca63)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:30.901053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:30.915077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d93f8-b94c-4a06-ae20-5d101fc2fbf7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:30.927432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:30.928890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:30.933316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:30.934165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:30.953768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:30.959065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172da0c-000a-4370-9f31-68de6c4aa9b5 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:31.010775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 848/1722] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:31.014693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.015204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.016484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.076398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d785f6f86f42349885701ef005ca63'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:31.095744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] MFA Rules not processed for user `919c94bd42144c9b86fd9977e85b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:31.105317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d785f6f86f42349885701ef005ca63'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:31.120383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:31.131398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d785f6f86f42349885701ef005ca63'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:31.132997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d785f6f86f42349885701ef005ca63'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:31.192342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f717ae52-9e78-43b5-9306-78527b1a59c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d785f6f86f42349885701ef005ca63'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:31.226604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 875/1723] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:30 2022] DELETE /identity/v3/users/54d785f6f86f42349885701ef005ca63 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:31.231270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.234630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.235818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.296798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:31.301310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:31.317357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 849/1724] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:31.582603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:31.651646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 876/1725] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:31.728763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:31.730551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:31.783096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc0fa-dd8a-4257-a576-477d1718f8e8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:31.946514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:31.949107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:31.949456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:31.949734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:31.977394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:31.982743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8fe59-3cb1-479f-88c9-50884b4c4650 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:32.007611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:32.023405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 850/1726] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:32.033204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:32.034991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:32.068765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86a5b-2e95-433d-9907-2ed7228e8f73 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:32.096533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:32.101223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.101674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.107383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] PATH_INFO: `/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.110971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1cefda23b9409c9e7b5063c4f7c1e9)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:32.119406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:32.278724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1cefda23b9409c9e7b5063c4f7c1e9', 'request_id': 'req-a9398d5d-a044-4a67-b2c8-45e6aa7da860'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:32.291684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1cefda23b9409c9e7b5063c4f7c1e9', 'request_id': 'req-a9398d5d-a044-4a67-b2c8-45e6aa7da860'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:32.319455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1cefda23b9409c9e7b5063c4f7c1e9', 'request_id': 'req-a9398d5d-a044-4a67-b2c8-45e6aa7da860'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:32.362233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] The token cache is being invalidate because project 1d1cefda23b9409c9e7b5063c4f7c1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:32.362929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:32.368875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a9398d5d-a044-4a67-b2c8-45e6aa7da860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:32.374717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 877/1727] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:32 2022] DELETE /identity/v3/projects/1d1cefda23b9409c9e7b5063c4f7c1e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:32.376424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.376706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.377028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.432935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:32.438792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:32.592723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 851/1728] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:32.596638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.597718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.598807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.640940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:32.649272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:32.667022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 878/1729] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:32.672293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:32.686431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec45e2f-dd2e-4873-84dc-5c016ffd9cc7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:32.698916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:32.699611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.699863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.700131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.700786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:32.701084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:32.702691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:32.733161 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 852/1730] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:32.735018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:32.759282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ecc515-f46d-49d5-805e-443c583fe5c5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:32.776093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:32.777972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.780161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.781150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.784614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:32.788827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573059f6-c91e-4923-9bb2-d374c69dfc1f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:32.864091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 879/1731] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:32 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:32.868398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:32.896156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b02a9-a625-45ad-8aac-303faac0c370 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:32.896301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008be87-2dc2-49d4-8d5e-bf0fc7a378c4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:32.896301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008be87-2dc2-49d4-8d5e-bf0fc7a378c4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:32.896301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008be87-2dc2-49d4-8d5e-bf0fc7a378c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:32.935634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8008be87-2dc2-49d4-8d5e-bf0fc7a378c4 None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:32.940515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8008be87-2dc2-49d4-8d5e-bf0fc7a378c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:33.048641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.050260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.051708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.052581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.053579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.057587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.066936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 880/1732] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Aug 6 20:37:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:33.110992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.110992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.111214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.147468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] MFA Rules not processed for user `86090cd4247d4d598eb1976f4224b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:33.148829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:33.178353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 853/1733] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:32 2022] POST /identity/v3/users => generated 296 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:33.181913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:33.276468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:33.308745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd929425-7049-4a49-8213-a25a12d59ad6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:33.339109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 881/1734] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:33.339109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:33.343842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.344471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.344754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.345026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.347170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:33.347919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.349449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.399893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389e89-1fba-4b27-b69c-6ac3ffbb0459 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:33.412196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.412828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.413109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.413380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.425315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 854/1735] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:33.428482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:33.433665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:33.438406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.441062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.464067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 882/1736] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:33.468542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:33.497968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b6007-27c0-4123-9eb2-fada507ceba7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:33.525852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a70b01-bc36-4248-bdc9-584af17be2eb service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:33.528961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.530430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.530723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.531031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] PATH_INFO: `/v3/projects/3a19680e636e49f482f5108871c7a086` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.534277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a19680e636e49f482f5108871c7a086)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.541958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.545596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.546218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.561775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.562170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.564375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.573971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6018074-9de5-4b7e-b5b1-c5ca94d68f2b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.610048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 883/1737] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:33.611516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321270c-25b7-4dcc-9239-fcbdd4a35909 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.612399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321270c-25b7-4dcc-9239-fcbdd4a35909 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.612912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321270c-25b7-4dcc-9239-fcbdd4a35909 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.615018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 884/1738] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 20:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:33.615975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321270c-25b7-4dcc-9239-fcbdd4a35909 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:33.651181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321270c-25b7-4dcc-9239-fcbdd4a35909 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:33.663265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:33.666561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.667500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.667782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] PATH_INFO: `/v3/projects/2bb66291a239476a841b68b8f081d68b/users/066b2d798df74cda940f7ade579e0dc9/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.698701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb66291a239476a841b68b8f081d68b, user_id=066b2d798df74cda940f7ade579e0dc9, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:33.702122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ded68d-4ac4-4145-b54b-868c24b20ec8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:33.725134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a19680e636e49f482f5108871c7a086', 'request_id': 'req-218ade21-619f-45b6-86dd-e6ea8315b245'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:33.736618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a19680e636e49f482f5108871c7a086', 'request_id': 'req-218ade21-619f-45b6-86dd-e6ea8315b245'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:33.739566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:33.750652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 885/1739] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:33 2022] PUT /identity/v3/projects/2bb66291a239476a841b68b8f081d68b/users/066b2d798df74cda940f7ade579e0dc9/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:33.755704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9372b9-4f80-403e-8682-ad511e088bcc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.758239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9372b9-4f80-403e-8682-ad511e088bcc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.759775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9372b9-4f80-403e-8682-ad511e088bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.760848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a19680e636e49f482f5108871c7a086', 'request_id': 'req-218ade21-619f-45b6-86dd-e6ea8315b245'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:33.785843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] The token cache is being invalidate because project 3a19680e636e49f482f5108871c7a086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:33.786968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:33.787858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-218ade21-619f-45b6-86dd-e6ea8315b245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:33.796879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 855/1740] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:33 2022] DELETE /identity/v3/projects/3a19680e636e49f482f5108871c7a086 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:33.798552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c806a77-64f9-4f14-a144-b8804d32d186 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:33.803877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c806a77-64f9-4f14-a144-b8804d32d186 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:33.804384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c806a77-64f9-4f14-a144-b8804d32d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:33.848136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-df9372b9-4f80-403e-8682-ad511e088bcc None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:33.849768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-df9372b9-4f80-403e-8682-ad511e088bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:33.910318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7c806a77-64f9-4f14-a144-b8804d32d186 None None] MFA Rules not processed for user `066b2d798df74cda940f7ade579e0dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:33.911757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7c806a77-64f9-4f14-a144-b8804d32d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.057845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 886/1741] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:34.059301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.059670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.059995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.098208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 856/1742] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:34.103144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:34.109692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556549-7f88-4b82-ba1f-318204373bd3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.110050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556549-7f88-4b82-ba1f-318204373bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.114322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b556549-7f88-4b82-ba1f-318204373bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.116123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.185499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4b556549-7f88-4b82-ba1f-318204373bd3 None None] MFA Rules not processed for user `28a58d55f9cc42c7a041884eee0ea248`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:34.189635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4b556549-7f88-4b82-ba1f-318204373bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.239622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 887/1743] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:34.240866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.244391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.277772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca270a2-e1f7-4764-9de9-313fad94dd7f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.299833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.300754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.301127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.301493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.302234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.307859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:34.335335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 857/1744] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:34.361360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.364583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.366210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.389688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 888/1745] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:34.394289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.398153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.427704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:34.430427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.494013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:34.531179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fcec8-58a5-4e7e-9330-cc9882b4b7b6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.538668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.540988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.540988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.540988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.556106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.563117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:34.608051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 889/1746] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:34.610212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.755731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 858/1747] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:34.757553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.792483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b5acb-f7f6-4704-bf05-fe94ec81b8ec None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.810710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.811616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.811897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.812278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.813020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:34.813393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.815623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:34.831949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 859/1748] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:34.832946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:34.834910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:34.851443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f3057-c1f5-4e35-92d0-4e77e02a03b6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.859227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5606c-5a7e-436f-a065-35b65f38eed3 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:34.862928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.863675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.864017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.864263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] PATH_INFO: `/v3/projects/1eaf417494fd445cb3b97dadef0d66fd` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.868522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaf417494fd445cb3b97dadef0d66fd)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.875287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:34.888513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:34.897899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:34.901347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:34.901767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:34.902075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:34.912377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:34.927470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.021972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 890/1749] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:34 2022] POST /identity/v3/users => generated 301 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:35.022997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.053512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaf417494fd445cb3b97dadef0d66fd', 'request_id': 'req-a82c9f44-b608-4f77-9406-c8053dccb1b1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.061789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a5070-3a12-44ce-afec-0113bac04e49 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.070840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaf417494fd445cb3b97dadef0d66fd', 'request_id': 'req-a82c9f44-b608-4f77-9406-c8053dccb1b1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.097317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaf417494fd445cb3b97dadef0d66fd', 'request_id': 'req-a82c9f44-b608-4f77-9406-c8053dccb1b1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.150610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] The token cache is being invalidate because project 1eaf417494fd445cb3b97dadef0d66fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:35.152353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.153798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.160427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 860/1750] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:34 2022] DELETE /identity/v3/projects/1eaf417494fd445cb3b97dadef0d66fd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:35.162431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.166002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.306521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.307109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.307636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.308055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.309040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.315810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.395493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 891/1751] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:35 2022] POST /identity/v3/projects => generated 403 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:35.395493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.397085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.443167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c9f44-b608-4f77-9406-c8053dccb1b1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.562270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:35.620114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1cb0-676d-42ce-b18b-11a3d614f374 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.639394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.641036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.641322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.641597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] PATH_INFO: `/v3/users/9a595a6da3864ffabce8590ca00099cf` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.642417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.647635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.647917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.649388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a595a6da3864ffabce8590ca00099cf)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.651415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.651989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.654493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.660132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.698833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 861/1752] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:35.699997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.704907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.740351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de8ced-c5af-4d40-9c31-f67f20f7efa7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.754031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:35.755516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:35.755938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:35.756339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:35.757177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:35.761740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a595a6da3864ffabce8590ca00099cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.761916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:35.777906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a595a6da3864ffabce8590ca00099cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.793585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a595a6da3864ffabce8590ca00099cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.795474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a595a6da3864ffabce8590ca00099cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.832423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a595a6da3864ffabce8590ca00099cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:35.844373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 892/1753] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:35 2022] DELETE /identity/v3/users/9a595a6da3864ffabce8590ca00099cf => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:35.845315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.847868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.856491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 862/1754] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:35 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:35.857680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:35.859691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:35.888050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b980a-9f65-412f-9ae9-8adf7f2b19ad admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:35.925600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.003998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d01c4d-da62-41ad-9c27-4edf49bb34f6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.011747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.012625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.013018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.013664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] PATH_INFO: `/v3/projects/83777c3057674482a9b095a60a385111/users/523d6c8d72b64ba280cacb231dbe0ded/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.061835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83777c3057674482a9b095a60a385111, user_id=523d6c8d72b64ba280cacb231dbe0ded, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.067041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.089017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 893/1755] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:35 2022] PUT /identity/v3/projects/83777c3057674482a9b095a60a385111/users/523d6c8d72b64ba280cacb231dbe0ded/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:36.092963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.093858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.094611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.094992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.095468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.097103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.098829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.127102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 863/1756] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:36.129404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.152071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c68421-b77b-4055-a61c-ccb4f7b9f713 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.219397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.230706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50fee1-c1c1-4a7c-9b30-5dd9d5e72ad5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.242492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.243342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.243575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.243699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.244362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.246260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.273579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 894/1757] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:36.274632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.296894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5ec1-749f-4858-af1d-5ce4e00c7408 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.307115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.313620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.313620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.313620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] PATH_INFO: `/v3/projects/83777c3057674482a9b095a60a385111/users/523d6c8d72b64ba280cacb231dbe0ded/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.314027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.315506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.315877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83777c3057674482a9b095a60a385111, user_id=523d6c8d72b64ba280cacb231dbe0ded, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.316066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.320663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b150a8d2-ad31-47b3-b009-4ec5b8b97731 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.321070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.322504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.324826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.346572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 895/1758] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:36 2022] PUT /identity/v3/projects/83777c3057674482a9b095a60a385111/users/523d6c8d72b64ba280cacb231dbe0ded/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:36.357739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.358029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.358449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.362865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 864/1759] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:36.367695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.391435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78f3b4-e49b-4370-8882-7a6ed9fc8067 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.418230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] MFA Rules not processed for user `523d6c8d72b64ba280cacb231dbe0ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:36.419502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.560573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.561739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.561739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.562072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] PATH_INFO: `/v3/projects/39f838fc53c44d7ab9ac58f27b039d41/users/d6b472c7233946bf93bfa118cf862228/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.591047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 896/1760] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:36.592413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.596106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.606065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f838fc53c44d7ab9ac58f27b039d41, user_id=d6b472c7233946bf93bfa118cf862228, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.610616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.635214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca901b5-c8db-4472-8d9e-56596e078112 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.659165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 865/1761] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:36 2022] PUT /identity/v3/projects/39f838fc53c44d7ab9ac58f27b039d41/users/d6b472c7233946bf93bfa118cf862228/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:36.659165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:36.673249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:36.742596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:36.775834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12259a-d4f6-40eb-bfcc-ad7f6750796d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:36.780647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.781403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.781787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.782160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.821900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:36.822559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.822838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.823113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] PATH_INFO: `/v3/projects/5705122f2779484b8fc0ff8becb16267` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:36.827660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5705122f2779484b8fc0ff8becb16267)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.833117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.957580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5705122f2779484b8fc0ff8becb16267', 'request_id': 'req-fff1b97a-f64d-4867-a93e-8471730d04c6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:36.962948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:36.966139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a0cd1-19d7-4c7b-a2cb-277cc4c4fe77 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:36.984326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5705122f2779484b8fc0ff8becb16267', 'request_id': 'req-fff1b97a-f64d-4867-a93e-8471730d04c6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:36.984849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 866/1762] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:36.987006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:36.987636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:36.988055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.024818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5705122f2779484b8fc0ff8becb16267', 'request_id': 'req-fff1b97a-f64d-4867-a93e-8471730d04c6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:37.035628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] MFA Rules not processed for user `d6b472c7233946bf93bfa118cf862228`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:37.037030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.040020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:37.078966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] The token cache is being invalidate because project 5705122f2779484b8fc0ff8becb16267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:37.079452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:37.081316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fff1b97a-f64d-4867-a93e-8471730d04c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:37.089811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 897/1763] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:36 2022] DELETE /identity/v3/projects/5705122f2779484b8fc0ff8becb16267 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:37.090959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.091271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.091557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.195517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:37.197997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.248772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 867/1764] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:37.249793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.256558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.394959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff4010-8823-4b80-bac0-fa605a4c0ca4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.406281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.406281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.406281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.406281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.406656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.407653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 898/1765] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:37.408890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.414540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.430818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab419274-b63a-4dc2-ba85-0498548accae None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.442906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.444251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.444815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.445420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.446618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.446947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:37.449207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b0605-534e-45d2-b18b-64cfe7ce46cc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.521646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.524199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 899/1766] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:37 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:37.524712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.534794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.535231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.541893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.542126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 868/1767] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:37.542126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.561919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2e5a8-0046-4921-97f5-63b31a4f69d9 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.597260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:37.601145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:37.671601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.672480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.672972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.674035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.676225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.681120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.719731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 869/1768] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:37 2022] POST /identity/v3/users => generated 309 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:37.722091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.749304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839ded7-8360-4ec4-9140-83a10a39a4d9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.782068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.787645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.788205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.789417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.794330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.807655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.831831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 900/1769] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:37.832961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.844606 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc636a6-281b-49f4-8670-bce1f0b93804 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.859151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.860148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.860148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.860492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.861020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:37.861320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.867359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.877053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 870/1770] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:37.879271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.897445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 901/1771] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:37.898797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:37.922023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590dd97-76ff-42e6-8e24-4c7219b4d1b9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.942627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.943270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.943544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.943810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:37.944439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:37.946780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:37.963462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bae20-5752-4f2e-8e51-affbd46d406e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:37.991033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:37.994851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:37.996971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:37.999987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] PATH_INFO: `/v3/projects/4b42f03acae446e59c56b19325d65708/users/094c601c02424b6abfc037cfc7abedf9/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.041750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 902/1772] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:37 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:38.054449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.092043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b42f03acae446e59c56b19325d65708, user_id=094c601c02424b6abfc037cfc7abedf9, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.103012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.186310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 871/1773] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:37 2022] PUT /identity/v3/projects/4b42f03acae446e59c56b19325d65708/users/094c601c02424b6abfc037cfc7abedf9/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:38.191863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.333838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:38.446470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc954c-4c6e-467f-a66c-59862dc23890 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.500715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390477f-d01c-4edd-abf2-3ac10c4a66b0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.511649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.512957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.514817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.515440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.516515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.518471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.534130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 872/1774] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:38.557289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.617994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337e8d-f47e-4f7b-8ce9-f4c2ce75bdd2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:38.625352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.626612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.626612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.627257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] PATH_INFO: `/v3/projects/4b42f03acae446e59c56b19325d65708/users/094c601c02424b6abfc037cfc7abedf9/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.630178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b42f03acae446e59c56b19325d65708, user_id=094c601c02424b6abfc037cfc7abedf9, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.644004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3bece-7b22-40f8-958a-8a052529105c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.673916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 873/1775] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:38 2022] PUT /identity/v3/projects/4b42f03acae446e59c56b19325d65708/users/094c601c02424b6abfc037cfc7abedf9/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:38.677014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.677582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.677977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.702003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:38.707934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:38.709178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:38.715422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:38.715422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:38.715422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:38.717202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:38.792011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] MFA Rules not processed for user `094c601c02424b6abfc037cfc7abedf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:38.793617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:38.799493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 903/1776] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:38 2022] POST /identity/v3/users => generated 283 bytes in 745 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:38.800769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:38.835292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7de6-ff94-4b75-a3f1-5ced9c42517e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.019275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.020941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.021286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.021641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.022371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.028250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.053299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 904/1777] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:39.058443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.063475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 874/1778] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:38 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:39.072468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2786a-4b37-4485-9099-9b715fbd34ad admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.077708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.078301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.079710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.080357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.081570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.082352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.084214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.099422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 905/1779] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:39.103680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.116720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018971b0-6760-4cfd-bb72-8d0935913387 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.130174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.132591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.133929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.134897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] PATH_INFO: `/v3/projects/6cbd63d9c1474671bdd56ae92f80a4b5/users/21ae7f56dc7243c2bc646c09bb4aebd3/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.175256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cbd63d9c1474671bdd56ae92f80a4b5, user_id=21ae7f56dc7243c2bc646c09bb4aebd3, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.180303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b80d92-a402-4eaf-b19c-6c627dfc3e4f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.226094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 906/1780] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:39 2022] PUT /identity/v3/projects/6cbd63d9c1474671bdd56ae92f80a4b5/users/21ae7f56dc7243c2bc646c09bb4aebd3/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:39.236350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.237571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.238021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.260741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b28db2-a815-4ad6-8e88-4ea9e194f675 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.298655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] MFA Rules not processed for user `21ae7f56dc7243c2bc646c09bb4aebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:39.301059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:39.335898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.413674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 907/1781] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:39.413983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.414613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.414716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.414918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.415156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.538279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122d26f-5990-4415-b511-bce93d92ac4f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:39.546447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:39.547200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:39.547681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:39.547940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:39.548636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.552624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.632548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 908/1782] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:39 2022] POST /identity/v3/projects => generated 363 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:39.636650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:39.661852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:39.672308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:39.678896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:39.706417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 875/1783] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:39.995668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bc399-4363-41c2-937f-6909e8bef3b8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.020839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.023778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.024120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.024428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.028200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.036243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.104609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 909/1784] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:39 2022] POST /identity/v3/users => generated 288 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:40.108621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.130411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ee88-9b6c-41e3-ad94-fbad16202e51 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.147029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.147764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.148055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.148705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.149711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.154564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.188515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 876/1785] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:40.192500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.209942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d732-352e-4724-b81f-17489ad3710c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.214414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.244440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.246537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.250354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f3196-503e-470f-8e7c-1fd772957703 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.250906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.253627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] PATH_INFO: `/v3/projects/51772d0300e3484d8149e6b2ba38397f/users/bbd3d0f6196e42649ae50b6ff3fce203/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.279265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.280166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.280604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.281002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] PATH_INFO: `/v3/users/d6b472c7233946bf93bfa118cf862228` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.284914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b472c7233946bf93bfa118cf862228)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.292133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.310347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51772d0300e3484d8149e6b2ba38397f, user_id=bbd3d0f6196e42649ae50b6ff3fce203, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.319918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.381732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 910/1786] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:40 2022] PUT /identity/v3/projects/51772d0300e3484d8149e6b2ba38397f/users/bbd3d0f6196e42649ae50b6ff3fce203/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:40.385798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.454085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:40.480227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b472c7233946bf93bfa118cf862228'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:40.501875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b472c7233946bf93bfa118cf862228'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:40.537841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b472c7233946bf93bfa118cf862228'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:40.592574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b472c7233946bf93bfa118cf862228'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:40.593529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-33440db8-aff1-4ecc-bf11-9d5bd879a064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b472c7233946bf93bfa118cf862228'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:40.629336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 877/1787] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:40 2022] DELETE /identity/v3/users/d6b472c7233946bf93bfa118cf862228 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:40.630603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ea96-5046-406a-b7ee-6edf6857dc8e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.633646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.634183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.636153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.681492 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:40.688812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:40.890126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.891374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.895145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.896011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 878/1788] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:40.897409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.898303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.899755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.900486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:40.903752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.949077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 911/1789] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:40.954309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864414a-7dc1-4ac2-905e-5b085d5e6f25 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:40.958218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:40.961141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:40.962232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:40.962232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:40.962428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] PATH_INFO: `/v3/users/6a487755cb5d499a8ec6fb1768933249` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:40.963816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a487755cb5d499a8ec6fb1768933249)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:40.965843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:40.966249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.126297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a487755cb5d499a8ec6fb1768933249'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:41.167837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a487755cb5d499a8ec6fb1768933249'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:41.168398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97330f8-6134-48bd-8897-8a016826b2e8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:41.170625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:41.180010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:41.181728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.182251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.183103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.187406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a487755cb5d499a8ec6fb1768933249'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:41.202316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:41.220415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:41.229205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a487755cb5d499a8ec6fb1768933249'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:41.234976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 912/1790] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:41.235815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:41.237446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.237605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-69ded098-907e-421f-963e-f05ec268e2fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a487755cb5d499a8ec6fb1768933249'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:41.257877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d5d1-7912-4632-bd5c-448723de2b38 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:41.266333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:41.267072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 879/1791] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:40 2022] DELETE /identity/v3/users/6a487755cb5d499a8ec6fb1768933249 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:41.268490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.268836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.269174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] PATH_INFO: `/v3/projects/51772d0300e3484d8149e6b2ba38397f/users/bbd3d0f6196e42649ae50b6ff3fce203/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.270315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea8ae2-80fe-4ea5-a7f0-2028b7cbf305 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.270805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea8ae2-80fe-4ea5-a7f0-2028b7cbf305 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.271145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea8ae2-80fe-4ea5-a7f0-2028b7cbf305 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.272087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51772d0300e3484d8149e6b2ba38397f, user_id=bbd3d0f6196e42649ae50b6ff3fce203, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:41.273093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 880/1792] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:37:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:41.274217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.274569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.274919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.275998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b787-d24e-4881-926d-dcb63b29b17c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:41.296057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 913/1793] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:41 2022] PUT /identity/v3/projects/51772d0300e3484d8149e6b2ba38397f/users/bbd3d0f6196e42649ae50b6ff3fce203/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:41.309478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.309840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.310181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.317265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:41.318285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.386314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] MFA Rules not processed for user `bbd3d0f6196e42649ae50b6ff3fce203`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:41.387573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.507372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:41.538508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 881/1794] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:41.650825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 914/1795] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:41.664075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:41.665803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.690666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:41.692219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:41.907634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caa15d-24b3-4c57-a79b-1445b674b91c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:41.916511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:41.917165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.918787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.919070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.921014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191163-0c6a-47d1-9f07-1ccaddcf5acc None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:41.931430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:41.932067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.933482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.933874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:41.942200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:41.947219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18040b-30e3-425c-b595-c8162cd9fafe service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:41.962009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:41.968526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:41.987586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 882/1796] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:41.993709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:41.996140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:41.996470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:42.009618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 915/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:42.062055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:42.066851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:42.254428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:42.256210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:42.288868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d546e-b422-401b-868c-260ae2fc812d service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:42.300620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:42.302162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:42.304036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:42.304417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:42.310026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:42.327219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 883/1798] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:42.425547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:42.427201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:42.450537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 916/1799] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:37:42.628775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:42.630482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:42.646811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ccfa19-69da-486f-b227-4a0bfc37c169 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:42.655355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:42.656680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:42.657162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:42.657534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:42.682980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:42.690033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:42.692776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:42.726396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 884/1800] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:37:43.412937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:43.415142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.436958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b868d27-d979-472d-8c7b-d2e29d612a4a service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:43.442193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:43.442831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.443114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.443551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] PATH_INFO: `/v3/users/066b2d798df74cda940f7ade579e0dc9` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.444683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b2d798df74cda940f7ade579e0dc9)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:43.447040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:43.499953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b2d798df74cda940f7ade579e0dc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.509733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b2d798df74cda940f7ade579e0dc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.526397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b2d798df74cda940f7ade579e0dc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.527099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b2d798df74cda940f7ade579e0dc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.534545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:43.541592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:43.543866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.545833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-52d5453a-6b2d-4b5c-b95b-23dee1ecba2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b2d798df74cda940f7ade579e0dc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.553676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 917/1801] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:43 2022] DELETE /identity/v3/users/066b2d798df74cda940f7ade579e0dc9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:43.558059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.558350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.558620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.563974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862949ef-cb01-4fc9-98be-05b96ccf910f service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:43.598374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:43.600317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.662177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:43.663742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.664760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.665263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] PATH_INFO: `/v3/projects/c13d6d0e4a334e6395c10030359a18fb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.668342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13d6d0e4a334e6395c10030359a18fb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:43.671978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:43.692553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 918/1802] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:43.693490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:43.694924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.710140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0492ed-54f8-4ca6-a9a7-aaf8ec618a50 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:43.719723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:43.720361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.721155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.721532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] PATH_INFO: `/v3/projects/39f838fc53c44d7ab9ac58f27b039d41` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.723278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f838fc53c44d7ab9ac58f27b039d41)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:43.725221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:43.747100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13d6d0e4a334e6395c10030359a18fb', 'request_id': 'req-770f66ac-0544-4ddb-965c-0221ac62f344'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.747100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13d6d0e4a334e6395c10030359a18fb', 'request_id': 'req-770f66ac-0544-4ddb-965c-0221ac62f344'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.754140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13d6d0e4a334e6395c10030359a18fb', 'request_id': 'req-770f66ac-0544-4ddb-965c-0221ac62f344'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.774528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] The token cache is being invalidate because project c13d6d0e4a334e6395c10030359a18fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:43.775126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.776017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.778100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 885/1803] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:43 2022] DELETE /identity/v3/projects/c13d6d0e4a334e6395c10030359a18fb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:43.779355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:43.780873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.813794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f838fc53c44d7ab9ac58f27b039d41', 'request_id': 'req-6d3db9c5-e00a-406f-a820-af41ada2874d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.820684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f838fc53c44d7ab9ac58f27b039d41', 'request_id': 'req-6d3db9c5-e00a-406f-a820-af41ada2874d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.828713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f838fc53c44d7ab9ac58f27b039d41', 'request_id': 'req-6d3db9c5-e00a-406f-a820-af41ada2874d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.853171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] The token cache is being invalidate because project 39f838fc53c44d7ab9ac58f27b039d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:43.853537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.855630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:43.872342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f66ac-0544-4ddb-965c-0221ac62f344 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:43.873873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 919/1804] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:43 2022] DELETE /identity/v3/projects/39f838fc53c44d7ab9ac58f27b039d41 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:43.876291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:43.880800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.933121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:43.951679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:43.955931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.956537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.956833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.960584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:43.984144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3db9c5-e00a-406f-a820-af41ada2874d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:43.990151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:43.991148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:43.991543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:43.992417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] PATH_INFO: `/v3/users/ae63da57dd6a4f97b970df3a01fca4a5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:43.995090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae63da57dd6a4f97b970df3a01fca4a5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:43.997036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:44.018784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:44.051753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:44.053345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:44.065759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 886/1805] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:44.066582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:44.068638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:44.084628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae63da57dd6a4f97b970df3a01fca4a5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.085378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dde5a-f1e1-4fd9-bf24-8011e69745d3 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:44.091599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:44.092514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:44.092813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:44.093083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] PATH_INFO: `/v3/users/094c601c02424b6abfc037cfc7abedf9` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:44.094770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=094c601c02424b6abfc037cfc7abedf9)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:44.096748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae63da57dd6a4f97b970df3a01fca4a5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.097807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:44.108928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae63da57dd6a4f97b970df3a01fca4a5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.110618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae63da57dd6a4f97b970df3a01fca4a5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.128539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae63da57dd6a4f97b970df3a01fca4a5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.136720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 920/1806] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:43 2022] DELETE /identity/v3/users/ae63da57dd6a4f97b970df3a01fca4a5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:44.176597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094c601c02424b6abfc037cfc7abedf9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.189545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094c601c02424b6abfc037cfc7abedf9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.203374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094c601c02424b6abfc037cfc7abedf9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.226318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094c601c02424b6abfc037cfc7abedf9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.228473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094c601c02424b6abfc037cfc7abedf9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:44.238983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 887/1807] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:44 2022] DELETE /identity/v3/users/094c601c02424b6abfc037cfc7abedf9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:44.784433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:44.787172 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:44.824845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:44.827150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:44.996279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8300b-67ee-4ec8-bb24-d6581fe6d7d7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.046855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f1eb2-151c-41b2-ba55-38c9936c1e7c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.053504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.053504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.053504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.053504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] PATH_INFO: `/v3/projects/4b42f03acae446e59c56b19325d65708` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.054475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b42f03acae446e59c56b19325d65708)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.056693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.059384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.194554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b42f03acae446e59c56b19325d65708', 'request_id': 'req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.195598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.196838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.198173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.198173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] PATH_INFO: `/v3/projects/2bb66291a239476a841b68b8f081d68b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.202130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb66291a239476a841b68b8f081d68b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.205938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.206331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b42f03acae446e59c56b19325d65708', 'request_id': 'req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.224134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b42f03acae446e59c56b19325d65708', 'request_id': 'req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.254334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] The token cache is being invalidate because project 4b42f03acae446e59c56b19325d65708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:45.254878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.256734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.262901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 888/1808] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:44 2022] DELETE /identity/v3/projects/4b42f03acae446e59c56b19325d65708 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:45.265759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.272187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.293516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.305034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb66291a239476a841b68b8f081d68b', 'request_id': 'req-abf36e9e-23cf-49b5-a403-85e4980d3070'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.313119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb66291a239476a841b68b8f081d68b', 'request_id': 'req-abf36e9e-23cf-49b5-a403-85e4980d3070'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.322778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb66291a239476a841b68b8f081d68b', 'request_id': 'req-abf36e9e-23cf-49b5-a403-85e4980d3070'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.345045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] The token cache is being invalidate because project 2bb66291a239476a841b68b8f081d68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:45.346165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.348240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-abf36e9e-23cf-49b5-a403-85e4980d3070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.350791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 921/1809] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:44 2022] DELETE /identity/v3/projects/2bb66291a239476a841b68b8f081d68b => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:45.353177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.353608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.355870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.381361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a2604-6884-4ba7-bcef-48aa0c93a2f7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.399398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.402311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.516731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.518081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.518469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.519275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] PATH_INFO: `/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.520849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0eb65a757e4d2984046abb5b17dd3b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.524159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.534207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 922/1810] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:45.535424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.541551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.561664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b92d7-1850-46e5-bcd3-fbba7acd90bf None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.568739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.569569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.569916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.570252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] PATH_INFO: `/v3/users/523d6c8d72b64ba280cacb231dbe0ded` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.571535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523d6c8d72b64ba280cacb231dbe0ded)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.574253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.599717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.609158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0eb65a757e4d2984046abb5b17dd3b', 'request_id': 'req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.622906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0eb65a757e4d2984046abb5b17dd3b', 'request_id': 'req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.632631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0eb65a757e4d2984046abb5b17dd3b', 'request_id': 'req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.660048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] The token cache is being invalidate because project 1f0eb65a757e4d2984046abb5b17dd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:45.660600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.663690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2bbbb1b5-4d71-4277-b655-3851f7e51a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.665802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 889/1811] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:45 2022] DELETE /identity/v3/projects/1f0eb65a757e4d2984046abb5b17dd3b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:45.668621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56427a2-0ff0-4e81-8138-f0260a6ea6be None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.670268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56427a2-0ff0-4e81-8138-f0260a6ea6be None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.670641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56427a2-0ff0-4e81-8138-f0260a6ea6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.673398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523d6c8d72b64ba280cacb231dbe0ded'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.685442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523d6c8d72b64ba280cacb231dbe0ded'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.695462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c56427a2-0ff0-4e81-8138-f0260a6ea6be None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.697041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c56427a2-0ff0-4e81-8138-f0260a6ea6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.698755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523d6c8d72b64ba280cacb231dbe0ded'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.699325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523d6c8d72b64ba280cacb231dbe0ded'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.716239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523d6c8d72b64ba280cacb231dbe0ded'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.726982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 923/1812] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:45 2022] DELETE /identity/v3/users/523d6c8d72b64ba280cacb231dbe0ded => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:45.728149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.729667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.794257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:45.802037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 890/1813] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:45.803958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.803958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.804267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.820628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a41fa-d16d-4dfe-8cff-cc2c916058f9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.828272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.829045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.829154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.829605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.829754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] PATH_INFO: `/v3/users/21ae7f56dc7243c2bc646c09bb4aebd3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.831036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.831446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ae7f56dc7243c2bc646c09bb4aebd3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.833449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.840096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 891/1814] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:45.840634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.851294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40606c2-ec0f-4ee3-aabc-7e9844a0901d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.856944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.857650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.858009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.858347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.859060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:45.859738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.861098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e267ab-3d35-4536-be89-34c540d0db95 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.875322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 892/1815] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:45.877653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.877876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.877988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.897793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ae7f56dc7243c2bc646c09bb4aebd3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.900214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.901938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.907842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ae7f56dc7243c2bc646c09bb4aebd3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.912402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 893/1816] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:45.913497 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.921391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ae7f56dc7243c2bc646c09bb4aebd3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.922083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ae7f56dc7243c2bc646c09bb4aebd3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.925208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2007b-42f4-4d90-9805-bcfb083b2e5d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:45.930491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:45.931397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.931680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.931972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.932679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:45.934593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2237c27-cb8f-4b07-9fde-b1375e7efd95 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:45.939000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ae7f56dc7243c2bc646c09bb4aebd3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:45.946465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 924/1817] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:45 2022] DELETE /identity/v3/users/21ae7f56dc7243c2bc646c09bb4aebd3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:45.947406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:45.948895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:45.970305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 894/1818] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:45.973821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:45.974295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:45.974772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:45.994989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:45.996319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.028191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50595f1f-b8c7-4077-abd2-8d80e3e9051b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.075716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 895/1819] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:46.075716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.075716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.088351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97310cf-0c6b-4999-853e-a612e287155d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.094379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.095024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.095024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.095308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.096451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.098490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.112805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.113621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.113929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.114268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.115003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:46.115466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.117261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.130475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 896/1820] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:46.130475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.136252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.141283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.163161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 925/1821] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:46.163161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.168797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.179490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0c9e-9c7e-462b-a99c-9955ff1d0dd1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.192788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.193450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.193955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.194067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.194778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.196618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.221773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 926/1822] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:46.221773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.234510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6e5f0-2771-4c0a-9ea1-33d0ba474765 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.240265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.241021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.241398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.241776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.242573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.244647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.258696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcdfda-f346-4f46-8f08-40f4aa8d6532 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.264293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.265153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.265578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.265990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.278746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.280871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.291309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 927/1823] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:46.293306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 897/1824] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:46.295344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.295460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.310148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348870f8-8338-47b2-a513-97c9a2c64840 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.404529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c86a-c394-4216-91f3-6f458bac53ea admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.434865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.436507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.437694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.437974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.442980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.445995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.446621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.447065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.447431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.447943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4586651-a80f-4c2c-9f22-c1628621d6c5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.448424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.450678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062e02-9b14-4854-9c18-3deeda3e640b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.476282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 928/1825] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:46.477751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2907c7-36ad-465e-aad1-362c6e7d9017 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.478637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2907c7-36ad-465e-aad1-362c6e7d9017 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.479182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2907c7-36ad-465e-aad1-362c6e7d9017 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.485036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 929/1826] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:37:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:46.486461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2907c7-36ad-465e-aad1-362c6e7d9017 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.509752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 898/1827] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:46.511957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c051be-abe2-4203-b381-2f74779e6139 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.512249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c051be-abe2-4203-b381-2f74779e6139 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.512628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c051be-abe2-4203-b381-2f74779e6139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.515560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2907c7-36ad-465e-aad1-362c6e7d9017 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.523597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.524268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.524546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.524813 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] PATH_INFO: `/v3/projects/71d77ac51b8c49af827a3e02fe93f04b/users/92419753bb1d43a8b4e7dd99ca95cd57/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.539960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-17c051be-abe2-4203-b381-2f74779e6139 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:46.541403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-17c051be-abe2-4203-b381-2f74779e6139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.550104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d77ac51b8c49af827a3e02fe93f04b, user_id=92419753bb1d43a8b4e7dd99ca95cd57, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.553385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.598628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 930/1828] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:46 2022] PUT /identity/v3/projects/71d77ac51b8c49af827a3e02fe93f04b/users/92419753bb1d43a8b4e7dd99ca95cd57/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:46.599972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.640784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 899/1829] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:46.654938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.670058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.670468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.708824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] MFA Rules not processed for user `92419753bb1d43a8b4e7dd99ca95cd57`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:46.711217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.729260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.732062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba635383-2501-4d20-a7b6-cb178c56ef2e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.737793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.738573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.738854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.739126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.739804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.741534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.757325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 931/1830] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:46.757325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.761214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.780351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2ec69-d4ff-467c-b843-644d22a1f6c6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.786783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.788022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.789083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.789083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] PATH_INFO: `/v3/projects/83777c3057674482a9b095a60a385111` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.790146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83777c3057674482a9b095a60a385111)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.792164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.794768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 900/1831] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:46.795804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.809721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90381a-f111-49d2-83c2-b166bcde5482 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.826870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:46.827784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:46.828170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:46.828432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:46.829003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:46.831520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:46.844851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:46.846139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 901/1832] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:46.846931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.849151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.864037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83777c3057674482a9b095a60a385111', 'request_id': 'req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:46.879841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83777c3057674482a9b095a60a385111', 'request_id': 'req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:46.891508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83777c3057674482a9b095a60a385111', 'request_id': 'req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:46.908093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] The token cache is being invalidate because project 83777c3057674482a9b095a60a385111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:46.909178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:46.910153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:46.914877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 932/1833] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:46 2022] DELETE /identity/v3/projects/83777c3057674482a9b095a60a385111 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:46.915787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:46.918234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:46.938341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809314-177e-4ce8-a9ef-8dc3b920ac1c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:46.998340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e4e4-cc3c-4d26-886f-76d39d1ed35b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.004459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.005434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.005710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.006031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.006669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.008678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.016414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.017035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.017319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.017612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.019832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.033236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.034830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.044029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 933/1834] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:46 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.044685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.046265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.049383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 902/1835] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:47.050142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.051562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.065325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa974ce-aa75-4782-8270-c8de113350dc service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.099831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.115650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c1c3-2284-40fe-b7ad-1bce7d574302 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.120796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.121453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.121728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.121997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] PATH_INFO: `/v3/projects/69e8a4f1798244eca801d7a34fb91f67/users/9f726c89c5a746f8a297f34a51106e54/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.132250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.132889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.133169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.133441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] PATH_INFO: `/v3/projects/6cbd63d9c1474671bdd56ae92f80a4b5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.134558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cbd63d9c1474671bdd56ae92f80a4b5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.136488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.137818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e8a4f1798244eca801d7a34fb91f67, user_id=9f726c89c5a746f8a297f34a51106e54, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.140553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a88ba-6809-4a1b-8f76-d7e892ab82bc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.153721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 934/1836] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:47 2022] PUT /identity/v3/projects/69e8a4f1798244eca801d7a34fb91f67/users/9f726c89c5a746f8a297f34a51106e54/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:47.154913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c502-c1b8-4321-96e8-057d28ab3f8a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.155194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c502-c1b8-4321-96e8-057d28ab3f8a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.155545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c502-c1b8-4321-96e8-057d28ab3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.181248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6577c502-c1b8-4321-96e8-057d28ab3f8a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:47.182450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6577c502-c1b8-4321-96e8-057d28ab3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.183992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cbd63d9c1474671bdd56ae92f80a4b5', 'request_id': 'req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.189997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cbd63d9c1474671bdd56ae92f80a4b5', 'request_id': 'req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.196125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cbd63d9c1474671bdd56ae92f80a4b5', 'request_id': 'req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.204798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.210841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] The token cache is being invalidate because project 6cbd63d9c1474671bdd56ae92f80a4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:47.211186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.212189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.213794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 903/1837] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:47 2022] DELETE /identity/v3/projects/6cbd63d9c1474671bdd56ae92f80a4b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:47.214607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.215985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.247714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 935/1838] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:47.249299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178ccf-fd54-404d-91d6-302ed5391307 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.249527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178ccf-fd54-404d-91d6-302ed5391307 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.249803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5178ccf-fd54-404d-91d6-302ed5391307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.277641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d5178ccf-fd54-404d-91d6-302ed5391307 None None] MFA Rules not processed for user `9f726c89c5a746f8a297f34a51106e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:47.278866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d5178ccf-fd54-404d-91d6-302ed5391307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.280297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7224e-31a1-4c30-b3cc-e5c19d7ffdd4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.286047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.286659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.286958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.287211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.287869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.289946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.311012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 904/1839] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.312028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.313829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.327680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606f62b-0d46-4c3d-b58e-4ff9369bf2eb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.335969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.336606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.336890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.337162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] PATH_INFO: `/v3/users/bbd3d0f6196e42649ae50b6ff3fce203` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.338285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd3d0f6196e42649ae50b6ff3fce203)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.340234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.346667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 936/1840] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:47.348138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.348601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.349001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.371263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:47.372540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.380953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 937/1841] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:47.381723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.390870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa4087-2742-4aee-b17e-4600a6a41119 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.392896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.394470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd3d0f6196e42649ae50b6ff3fce203'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.396060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.396644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.396930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.397244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.398006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.399439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.403684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd3d0f6196e42649ae50b6ff3fce203'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.411252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 938/1842] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:47.412360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.412864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd3d0f6196e42649ae50b6ff3fce203'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.413974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.426777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886f00f-ee34-4e35-980e-93c738a99ba7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.426905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd3d0f6196e42649ae50b6ff3fce203'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.427585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd3d0f6196e42649ae50b6ff3fce203'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:47.431418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.431991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.432261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.432525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.433127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.436776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 905/1843] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:47 2022] DELETE /identity/v3/users/bbd3d0f6196e42649ae50b6ff3fce203 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:47.436776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.436964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.437517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.479622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 939/1844] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.481140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.487138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.518255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dc330-5d25-4d2f-90a0-4a253438eec0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.576178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a2d32-e40f-4569-ac88-ca2af3c808f8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.603007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.603692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.604594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.604867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.605762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:47.606690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.609266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.609904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.611676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.611676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.611676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] PATH_INFO: `/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f/users/d1ef386053ba460aaa88e6c01355099e/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.631233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 906/1845] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:47.631233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.640435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:47.649009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7f0f56e03d4414ab2c52a30d381d8f, user_id=d1ef386053ba460aaa88e6c01355099e, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.653430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.672310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006d468-0b01-4841-8d12-6c54ad3a311a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.718804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.720132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.720704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.721168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.724145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.726100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.728825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.731210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 940/1846] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:47 2022] PUT /identity/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f/users/d1ef386053ba460aaa88e6c01355099e/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:47.732768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.757066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 907/1847] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.757922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.776140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e6a6-7b88-482b-98fa-86df4d0fc003 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.841244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cba093-e8de-4397-a38e-02b8c7ea2e58 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:47.850389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.851412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.851794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.852404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.853146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.855403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.912054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 941/1848] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:47.912904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:47.917080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:47.953250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:47.958355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:47.958355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:47.958355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:47.958884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:47.960575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:47.991747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 908/1849] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:47.996331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.004987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd2573-f0dc-4a01-bdfe-e901be3f24b7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.017167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37757f0d-58f7-4c72-a1b4-f6e169b05327 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.027656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.028550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.028988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.029572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.030591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.033664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.034219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.034352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.034590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.034865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.035572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.038086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.062838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 942/1850] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:48.067532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.072527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 909/1851] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:47 2022] POST /identity/v3/users => generated 292 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:48.072527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.083828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b2ec-754b-4044-860f-807ac2e73384 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.092764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.093045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f1b33-0da6-447a-b19c-1c55f0dbbd4c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.096404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.096931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.097403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] PATH_INFO: `/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f/users/d1ef386053ba460aaa88e6c01355099e/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.100491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.100938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7f0f56e03d4414ab2c52a30d381d8f, user_id=d1ef386053ba460aaa88e6c01355099e, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.101220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.101500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.101954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] PATH_INFO: `/v3/projects/c81abeb652aa4149b79a7e85775f8560/users/d54e9118fa3d4c6eae2cd80d983e0b9a/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.105357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.124104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 943/1852] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:48 2022] PUT /identity/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f/users/d1ef386053ba460aaa88e6c01355099e/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:48.125976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.140369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81abeb652aa4149b79a7e85775f8560, user_id=d54e9118fa3d4c6eae2cd80d983e0b9a, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.143838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935336a-e1ab-4d00-aae8-75c7df9f9d2f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.162096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 910/1853] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:48 2022] PUT /identity/v3/projects/c81abeb652aa4149b79a7e85775f8560/users/d54e9118fa3d4c6eae2cd80d983e0b9a/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:48.163809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.164348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.164633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.200440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] MFA Rules not processed for user `d1ef386053ba460aaa88e6c01355099e`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:48.202096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.208956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348e0dd-1e4b-421a-8c6a-2bdca6a6fc07 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.225110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.286325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.287373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.288076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.288984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.290087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.290584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 911/1854] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:48.292080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.295529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.311165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 944/1855] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:48.313026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.315004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.326738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba32e5-9bbf-46fa-9283-a7680b9b9159 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.343070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.343838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.345236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.353390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.354231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.358374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.393325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 912/1856] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:48.394568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.416698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ce0d5-7172-43fc-85db-032292e9dcbf admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.422199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.422971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.423341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.424647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.425423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.427144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.431423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ae4cc-7dbe-40e0-8a35-ef221cbcb4fa admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.436674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.437977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.438292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.438567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.445480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 913/1857] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:48.449468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.451166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.452644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.464422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7bb49-a73f-48f2-9342-75825627ac44 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.464716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 945/1858] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:48.465520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.477401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471cda2-ef2d-49f2-911e-391cee7e9e1c service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.479986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.480672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.480948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.481220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] PATH_INFO: `/v3/projects/c81abeb652aa4149b79a7e85775f8560/users/d54e9118fa3d4c6eae2cd80d983e0b9a/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.483784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.484451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.484811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.485085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] PATH_INFO: `/v3/projects/4134d52fdc824a598e5021723f61c344/users/b5114c9e768246bca6622ecf87ca3b8f/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.487082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81abeb652aa4149b79a7e85775f8560, user_id=d54e9118fa3d4c6eae2cd80d983e0b9a, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.500920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21127800-9c34-480a-b4c0-4dd3a432ca70 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.506929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4134d52fdc824a598e5021723f61c344, user_id=b5114c9e768246bca6622ecf87ca3b8f, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.510834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f933-caa8-4261-b59e-4084e58a412c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.539989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 946/1859] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:48 2022] PUT /identity/v3/projects/4134d52fdc824a598e5021723f61c344/users/b5114c9e768246bca6622ecf87ca3b8f/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:48.548964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 914/1860] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:48 2022] PUT /identity/v3/projects/c81abeb652aa4149b79a7e85775f8560/users/d54e9118fa3d4c6eae2cd80d983e0b9a/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:48.553135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.553135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.553135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.555548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.555831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.556103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.610605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] MFA Rules not processed for user `d54e9118fa3d4c6eae2cd80d983e0b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:48.613030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.617378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] MFA Rules not processed for user `b5114c9e768246bca6622ecf87ca3b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:48.618792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.666662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.712621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 915/1861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:48.714230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.726182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 947/1862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:48.726947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.730454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.763745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:48.799544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1e63-3348-409a-b6b9-d82688032aa5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.805137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.806461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.806745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.807013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.809315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:48.810137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc84f1-061a-42bf-b6af-083864b6edde None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.814834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.815478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.815753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.816019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.832507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.834966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.851179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 948/1863] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:48.852190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:48.924649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:48.928301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:48.947666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 916/1864] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:48.985475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb6f8c-99ea-4a45-a670-389f60848f5f service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:48.994782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:48.997085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:48.997602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:48.998732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:48.999772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.005757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.079750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 949/1865] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:48 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:49.083643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.097113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6a440-5e8c-4235-9fa9-6b6dc78c449f service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.143319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.227606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.228226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.228503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.228768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.229404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.232329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.271134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294900-c380-4711-9c56-3859faebe661 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.278831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 917/1866] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:49 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:49.283491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.289198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.289856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.292347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.292559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] PATH_INFO: `/v3/users/9f726c89c5a746f8a297f34a51106e54` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.293764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f726c89c5a746f8a297f34a51106e54)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.297525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.305512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7b9a-79e8-4470-be35-4584bbce0af4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.317614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.318350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.318615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.318886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.327679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.329313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.349674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 918/1867] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:49.353877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.376774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159833ce-fdef-461f-a61f-d2fce4ef7d3f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.383007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.384025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.384472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.384885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] PATH_INFO: `/v3/projects/02a9b01602f64b3d9f14af52643dd688/users/205ec1f133a34cbba39182d3a2213061/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.389146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:49.390559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f726c89c5a746f8a297f34a51106e54'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.393614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:49.401133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f726c89c5a746f8a297f34a51106e54'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.409007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a9b01602f64b3d9f14af52643dd688, user_id=205ec1f133a34cbba39182d3a2213061, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.412974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.414435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f726c89c5a746f8a297f34a51106e54'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.416166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f726c89c5a746f8a297f34a51106e54'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.436924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 919/1868] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:49 2022] PUT /identity/v3/projects/02a9b01602f64b3d9f14af52643dd688/users/205ec1f133a34cbba39182d3a2213061/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:49.437969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e20e152-9e20-44a1-bac9-208004cf78ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f726c89c5a746f8a297f34a51106e54'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.439298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.442999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.449548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 950/1869] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:49 2022] DELETE /identity/v3/users/9f726c89c5a746f8a297f34a51106e54 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:49.453932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.454222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.454498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.485170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:49.487513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.572666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35994-6c51-43d0-b523-bc8564cd104c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.612496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 951/1870] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:49.614011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.618454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.633366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f7adc-ef08-4e09-89b4-0680b1efbc3e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.651969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.652972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.652972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.653644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] PATH_INFO: `/v3/projects/51772d0300e3484d8149e6b2ba38397f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.654487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=51772d0300e3484d8149e6b2ba38397f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.656598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.741528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.741685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.741938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.742216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.742874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:49.747471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:49.771881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 920/1871] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:49.773066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.774339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.774867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51772d0300e3484d8149e6b2ba38397f', 'request_id': 'req-5cff6afa-7f1b-4415-9248-be218588b2ed'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.795112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51772d0300e3484d8149e6b2ba38397f', 'request_id': 'req-5cff6afa-7f1b-4415-9248-be218588b2ed'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.810948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51772d0300e3484d8149e6b2ba38397f', 'request_id': 'req-5cff6afa-7f1b-4415-9248-be218588b2ed'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.861593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] The token cache is being invalidate because project 51772d0300e3484d8149e6b2ba38397f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:49.862587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.866605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:49.888508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 952/1872] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:49 2022] DELETE /identity/v3/projects/51772d0300e3484d8149e6b2ba38397f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:49.888508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:49.888508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.903951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73a926-0322-4d9c-ab15-125f360a619e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:49.958187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:49.966858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:49.967524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:49.968212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:49.968930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:49.972153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:49.993380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:50.018812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff6afa-7f1b-4415-9248-be218588b2ed admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.024862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.025614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.026340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.026644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] PATH_INFO: `/v3/projects/02a9b01602f64b3d9f14af52643dd688/users/205ec1f133a34cbba39182d3a2213061/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.029878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a9b01602f64b3d9f14af52643dd688, user_id=205ec1f133a34cbba39182d3a2213061, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.034873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58de87c-3e0b-45d8-b7f7-352a30ef01cf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.055961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.062672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7a4c3-5782-4c5b-b24b-46b65ca3718e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.068971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 953/1873] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:49 2022] PUT /identity/v3/projects/02a9b01602f64b3d9f14af52643dd688/users/205ec1f133a34cbba39182d3a2213061/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:50.071005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3690c-3092-4c84-bc05-2802300257fd None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.071165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3690c-3092-4c84-bc05-2802300257fd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.071513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3690c-3092-4c84-bc05-2802300257fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.099650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 921/1874] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:50.100996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.102020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.102292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.132328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5ff3690c-3092-4c84-bc05-2802300257fd None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:50.133562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5ff3690c-3092-4c84-bc05-2802300257fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.151888 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] MFA Rules not processed for user `205ec1f133a34cbba39182d3a2213061`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:50.154244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.229367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 954/1875] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:50.247017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.247350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.247637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.249592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 922/1876] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:50.262906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.268370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.315165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:50.320733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.351963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 955/1877] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:50.356644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.379288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ad7aa-9ec1-4167-b17d-401536fead54 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.389529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.390153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.390424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.390691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.395642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:50.396738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.398364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.399208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba9dd-7c23-4c46-ab5a-0b44dc05696e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.410623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.411527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.411986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.412454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.431661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 956/1878] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:37:50.437050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.442700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.443597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.457777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 923/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:50.464393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefa94-8027-4166-9b34-a5e600543b6d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.474806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.477428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.477885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.478014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.478211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.478481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.479288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.481961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.509452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3199998-39dc-49dc-94b5-8d946811302f service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.521024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 957/1880] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:50.530417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.531237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.531865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.532522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.534679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] PATH_INFO: `/v3/projects/69e8a4f1798244eca801d7a34fb91f67` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.538183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e8a4f1798244eca801d7a34fb91f67)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.540454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.587371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:50.648497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0823-2f77-44ee-8350-1fc4e6afd9ad admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.649943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e8a4f1798244eca801d7a34fb91f67', 'request_id': 'req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.659233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e8a4f1798244eca801d7a34fb91f67', 'request_id': 'req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.677703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e8a4f1798244eca801d7a34fb91f67', 'request_id': 'req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.715652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] The token cache is being invalidate because project 69e8a4f1798244eca801d7a34fb91f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:50.715958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.720293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.728707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 924/1881] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:50 2022] DELETE /identity/v3/projects/69e8a4f1798244eca801d7a34fb91f67 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:50.729758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.732921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.748800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:50.763836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.764932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.766153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.766645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.768046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.771689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.816633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 958/1882] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:50 2022] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:50.817726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:50.819455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.831005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f7ae-2be4-411b-8341-86ad1e9d7aa6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.832908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4a3e5-1825-4501-90f6-17438055b31e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:50.838274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.838919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.839236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.839468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] PATH_INFO: `/v3/users/d54e9118fa3d4c6eae2cd80d983e0b9a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.840712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54e9118fa3d4c6eae2cd80d983e0b9a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:50.843346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:50.858634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:50.860244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:50.861873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:50.862800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:50.872474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:50.921501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54e9118fa3d4c6eae2cd80d983e0b9a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.947485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54e9118fa3d4c6eae2cd80d983e0b9a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.963019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54e9118fa3d4c6eae2cd80d983e0b9a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.965193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54e9118fa3d4c6eae2cd80d983e0b9a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.984565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54e9118fa3d4c6eae2cd80d983e0b9a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:50.994516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 959/1883] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:37:50 2022] DELETE /identity/v3/users/d54e9118fa3d4c6eae2cd80d983e0b9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:50.996517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.007237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.024884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.027719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.048339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 925/1884] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:37:51.095897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66279f6b-4e4e-4730-bdaa-436df57315b0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.102272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.103901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.103901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.104328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.105070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.106779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.121648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 960/1885] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:51.122255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.124196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.138936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc5be7-5c1d-4c7f-87fa-c18cb29d47ef service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.154619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.155537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.155537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.155928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.156569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.159344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78eb2d-f6b1-4cfb-989f-6e973b1a959f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.177919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 926/1886] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:51.182546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.194031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488ae42-85eb-4791-858d-70940aa094ed admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.199748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.200414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.200696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.200973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] PATH_INFO: `/v3/projects/0d86349c5d664c29b309fcd551882992/users/cfc723ea96524b8fb91c2a53b3934225/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.218101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d86349c5d664c29b309fcd551882992, user_id=cfc723ea96524b8fb91c2a53b3934225, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.221454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.250484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 961/1887] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:51 2022] PUT /identity/v3/projects/0d86349c5d664c29b309fcd551882992/users/cfc723ea96524b8fb91c2a53b3934225/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:51.257138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.257572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.257846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.302199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] MFA Rules not processed for user `cfc723ea96524b8fb91c2a53b3934225`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.303633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.371188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.435668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 927/1888] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:51.440271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.523279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.556951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.558566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.592384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaae297-138a-413a-bfcf-fa5287cfb230 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.604572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.605397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.605858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.606375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.607083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.609292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.639284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 962/1889] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:51.642729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.655686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafd372-d3dd-434b-8255-a79b68cb4ecd None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.711072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8832d60-9b79-447e-9f94-653a745a420b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.714955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.715619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.715826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.715927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.716154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] PATH_INFO: `/v3/projects/c81abeb652aa4149b79a7e85775f8560` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.716323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.716665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.716862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.717248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81abeb652aa4149b79a7e85775f8560)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.717469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.719178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.719376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.742805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 963/1890] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:51.746664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.757413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6af3-394c-4e8a-b990-81624a65c57d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.771640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81abeb652aa4149b79a7e85775f8560', 'request_id': 'req-78ec1ced-5613-4eef-bedb-8e15f39234fa'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:51.777580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81abeb652aa4149b79a7e85775f8560', 'request_id': 'req-78ec1ced-5613-4eef-bedb-8e15f39234fa'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:51.783979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81abeb652aa4149b79a7e85775f8560', 'request_id': 'req-78ec1ced-5613-4eef-bedb-8e15f39234fa'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:51.796495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] The token cache is being invalidate because project c81abeb652aa4149b79a7e85775f8560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:37:51.796809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:51.797800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-78ec1ced-5613-4eef-bedb-8e15f39234fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:37:51.799332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 928/1891] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:37:51 2022] DELETE /identity/v3/projects/c81abeb652aa4149b79a7e85775f8560 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:51.803963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd7a06-1743-461c-8001-6afff54d6069 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.804242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd7a06-1743-461c-8001-6afff54d6069 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.804513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd7a06-1743-461c-8001-6afff54d6069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.816286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.816901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.817181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.817452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.818096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.819717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.823979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-dedd7a06-1743-461c-8001-6afff54d6069 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.825169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dedd7a06-1743-461c-8001-6afff54d6069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.829661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 964/1892] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:51.833423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 929/1893] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:51.834245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.835878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.840585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.840854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.841122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.848406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0d9f-d734-471a-b40b-56044b6cb414 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.853195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.853972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.854248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.854518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] PATH_INFO: `/v3/projects/d1f5814c083946f98678d7cca12ec3b2/users/a7d9680ceb6b40c69d6104e0b1197024/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.859390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:51.860566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:51.869578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 930/1894] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:51.870967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f5814c083946f98678d7cca12ec3b2, user_id=a7d9680ceb6b40c69d6104e0b1197024, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.873812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.876016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.881018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.888637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4ccbe-2962-4023-b491-7edfdf007dfa None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.889126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 965/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:51 2022] PUT /identity/v3/projects/d1f5814c083946f98678d7cca12ec3b2/users/a7d9680ceb6b40c69d6104e0b1197024/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:51.893021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.904838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:51.946781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.947414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.947716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.947984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.948615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:37:51.948914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.950642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.956530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9bfcf-5e8c-4cdf-af60-cd50cf75f9b4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.961350 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.961953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.962233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.962525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.963148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.964777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:51.965393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 931/1896] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:37:51.971412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.981813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada06cbf-1fe5-4a27-9a2f-32abf09af2a7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:51.984721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 966/1897] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:51.987430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:51.988368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:51.988676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:51.988896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:51.989519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:51.989749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:51.991470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.005915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08f5f8-083e-4728-98c3-da540cd41348 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.013734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.014408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.014769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.015163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] PATH_INFO: `/v3/projects/d1f5814c083946f98678d7cca12ec3b2/users/a7d9680ceb6b40c69d6104e0b1197024/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.018405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f5814c083946f98678d7cca12ec3b2, user_id=a7d9680ceb6b40c69d6104e0b1197024, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.021612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeae416-6e14-4267-a132-9e7f3c5f2cc0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.026721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 932/1898] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:51 2022] POST /identity/v3/projects => generated 409 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:52.027895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.038008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 967/1899] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:51 2022] PUT /identity/v3/projects/d1f5814c083946f98678d7cca12ec3b2/users/a7d9680ceb6b40c69d6104e0b1197024/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:52.049425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.049948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.050085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.105031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676671c0-ffe6-4f3e-9ba2-7227a11b0eef admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.115515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] MFA Rules not processed for user `a7d9680ceb6b40c69d6104e0b1197024`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:52.117604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:52.208390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.209404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.209879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.210343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.211203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.213375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.245862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 933/1900] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/users => generated 305 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:52.248468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.260682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090682-a9f5-4be8-9f28-b14f7f06ff71 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.269645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 968/1901] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:52.274927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.276248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.276916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.277437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.278701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.279039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.280509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:52.281538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.289585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.302664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 934/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:52.303986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.317544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a33ed-4561-4006-bb74-65d124809564 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.345082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10704f-0929-4714-8807-e844392db771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.347378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10704f-0929-4714-8807-e844392db771 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.350349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10704f-0929-4714-8807-e844392db771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.350762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10704f-0929-4714-8807-e844392db771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.351560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10704f-0929-4714-8807-e844392db771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.358580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10704f-0929-4714-8807-e844392db771 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.400702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 935/1903] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:52.401884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10704f-0929-4714-8807-e844392db771 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.405641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be754a57-d6c3-4471-86e1-3ef2dce2dbed None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.409651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.410281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.410564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.410868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.417772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10704f-0929-4714-8807-e844392db771 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.420829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:52.422890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.424209 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.424495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.424750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] PATH_INFO: `/v3/projects/0e84a0691d9a48968252202ba14efab3/users/ebf8abf46245432f889c3610233e8e79/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.444682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e84a0691d9a48968252202ba14efab3, user_id=ebf8abf46245432f889c3610233e8e79, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.447562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56681bc9-f513-4dbf-83bf-0d8aea40f1b5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.471930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 936/1904] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:52 2022] PUT /identity/v3/projects/0e84a0691d9a48968252202ba14efab3/users/ebf8abf46245432f889c3610233e8e79/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:52.482367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b3a8-d8b4-4a41-9874-d37343b55b82 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.482690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b3a8-d8b4-4a41-9874-d37343b55b82 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.483036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b3a8-d8b4-4a41-9874-d37343b55b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.486352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:52.524729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.526320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.530548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8096b3a8-d8b4-4a41-9874-d37343b55b82 None None] MFA Rules not processed for user `ebf8abf46245432f889c3610233e8e79`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:52.532206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8096b3a8-d8b4-4a41-9874-d37343b55b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:52.561150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 969/1905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:37:52.631571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 937/1906] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:37:52.635846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.650939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0415972-4430-4939-803e-3e8591209898 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:52.783271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:52.784066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.784950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.786664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.787498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:52.792325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:52.806059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba649f-8091-4a7b-bde1-02440487016f None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.806845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba649f-8091-4a7b-bde1-02440487016f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.807098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba649f-8091-4a7b-bde1-02440487016f None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.809077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 938/1907] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:37:52.820036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:52.820321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:52.820598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:52.859717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 970/1908] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/projects => generated 409 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:37:52.864184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:52.871010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:52.872442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:53.051944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 939/1909] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:53.058746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eadc86-f927-4fe4-a045-dfe0bde2b42c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.065787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.066619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.066994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.067334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.068605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.070715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.105387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.111975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 971/1910] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:37:52 2022] POST /identity/v3/users => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:37:53.117730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3ed4d-4a44-4b32-885c-5cf7e0b05bf7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.122610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.123832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.124174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.124512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.125582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.127287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.158972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 940/1911] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:37:53.160086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.175003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16bbc1-254b-4172-bafb-d71857c40576 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.182669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.183225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.183563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.183841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] PATH_INFO: `/v3/projects/1551acb67e2a491bb576373cf9804e7a/users/820650d5107748b8914e5da01e34d17d/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.207365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1551acb67e2a491bb576373cf9804e7a, user_id=820650d5107748b8914e5da01e34d17d, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.210084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.226331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 972/1912] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:53 2022] PUT /identity/v3/projects/1551acb67e2a491bb576373cf9804e7a/users/820650d5107748b8914e5da01e34d17d/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:37:53.230311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.242681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78d249-aa35-47b9-a963-dce57a7f1259 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.280602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.307416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.308026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.308305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.309207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.309862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.311484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.321836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 941/1913] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:37:53.326267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.337739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abe06b-dc20-4988-9ad9-6bd7f0bd3896 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.346295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.347460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.347816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.348163 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] PATH_INFO: `/v3/projects/1551acb67e2a491bb576373cf9804e7a/users/820650d5107748b8914e5da01e34d17d/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.348960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.352337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1551acb67e2a491bb576373cf9804e7a, user_id=820650d5107748b8914e5da01e34d17d, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.354777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:53.355558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a3a14-c57d-4caf-9328-2035efeabf8e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.376085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 973/1914] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:37:53 2022] PUT /identity/v3/projects/1551acb67e2a491bb576373cf9804e7a/users/820650d5107748b8914e5da01e34d17d/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:37:53.387950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.388283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.388554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.409127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.417922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] MFA Rules not processed for user `820650d5107748b8914e5da01e34d17d`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:37:53.419123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:53.431863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de7b82-7359-4dc9-9433-f4a5959060ee admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.493893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 974/1915] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:37:53.504285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.505617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:37:53.507110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.507736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.508010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.508276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.517400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.518967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.528905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 942/1916] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:37:53.563127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192baba-0b60-4bba-868a-504cfe92015e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.567494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.568130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.568404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.568671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.577922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.579360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.589143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 975/1917] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:37:53.741934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:37:53.751116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739f59-90af-4f82-9726-1bf80137886f service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:37:53.755260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:37:53.755851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:37:53.756125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:37:53.756392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:37:53.808244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:37:53.812387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:37:53.813805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:37:53.822532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 943/1918] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:03.584958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=55 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.657098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.659099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:03.735274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e009bd-217d-476a-bd64-efc12cb067d6 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.739913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.740614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.740954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.741286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] PATH_INFO: `/v3/users/b5114c9e768246bca6622ecf87ca3b8f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.742462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5114c9e768246bca6622ecf87ca3b8f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.744435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.800681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5114c9e768246bca6622ecf87ca3b8f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:03.808088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.809806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5114c9e768246bca6622ecf87ca3b8f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:03.822552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5114c9e768246bca6622ecf87ca3b8f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:03.823345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5114c9e768246bca6622ecf87ca3b8f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:03.824067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:03.832348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6071-ad8b-4c31-b817-437f08057d25 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:03.836123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:03.836718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.836998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.837264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.837593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-735d1871-3938-41ae-b54f-76d96f5eadc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5114c9e768246bca6622ecf87ca3b8f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:03.838987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:03.846949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 976/1919] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:03 2022] DELETE /identity/v3/users/b5114c9e768246bca6622ecf87ca3b8f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:03.848335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:03.848625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:03.848900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:03.868999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:03.870205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:03.902036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:03.903504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:03.913462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 944/1920] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:03.929754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 977/1921] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:03.940010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:03.941442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:03.997768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa07b8-d24a-417a-a4b1-7ee585c2c93b service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:04.054208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:04.054768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:04.055048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:04.055373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:04.066184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:04.067690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:04.079130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 945/1922] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:04.480890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:04.482401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:04.497179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03d4a-83e7-41d4-9923-c6931d3373b0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:04.504519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:04.505248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:04.505442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:04.505709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] PATH_INFO: `/v3/projects/4134d52fdc824a598e5021723f61c344` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:04.506823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4134d52fdc824a598e5021723f61c344)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:04.508772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:04.525927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:04.558165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4134d52fdc824a598e5021723f61c344', 'request_id': 'req-4422c0d9-918b-4722-9466-616671c6a2d7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.564977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4134d52fdc824a598e5021723f61c344', 'request_id': 'req-4422c0d9-918b-4722-9466-616671c6a2d7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.571376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4134d52fdc824a598e5021723f61c344', 'request_id': 'req-4422c0d9-918b-4722-9466-616671c6a2d7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.589745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] The token cache is being invalidate because project 4134d52fdc824a598e5021723f61c344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:04.590317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.590789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.592317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 978/1923] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:04 2022] DELETE /identity/v3/projects/4134d52fdc824a598e5021723f61c344 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:04.597396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:04.608605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70757-ceb5-465d-85a0-242615f4923a service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:04.656879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:04.666277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:04.666921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:04.667187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:04.667498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] PATH_INFO: `/v3/users/205ec1f133a34cbba39182d3a2213061` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:04.668607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205ec1f133a34cbba39182d3a2213061)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:04.670559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:04.721021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205ec1f133a34cbba39182d3a2213061'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.727961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205ec1f133a34cbba39182d3a2213061'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.734624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205ec1f133a34cbba39182d3a2213061'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.746744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205ec1f133a34cbba39182d3a2213061'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.747385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-541ad858-b038-4529-b009-e38a3450f4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205ec1f133a34cbba39182d3a2213061'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:04.753125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 946/1924] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:04 2022] DELETE /identity/v3/users/205ec1f133a34cbba39182d3a2213061 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:05.039329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.041939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.087564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422c0d9-918b-4722-9466-616671c6a2d7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.152229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.152957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.153233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.153498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] PATH_INFO: `/v3/projects/02a9b01602f64b3d9f14af52643dd688` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.154592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a9b01602f64b3d9f14af52643dd688)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.156500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.202440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a9b01602f64b3d9f14af52643dd688', 'request_id': 'req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:05.208234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a9b01602f64b3d9f14af52643dd688', 'request_id': 'req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:05.214223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a9b01602f64b3d9f14af52643dd688', 'request_id': 'req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:05.227237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] The token cache is being invalidate because project 02a9b01602f64b3d9f14af52643dd688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:05.227552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:05.228214 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1a45d802-f8e1-4a64-9b53-8b678ece8bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:05.229779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 979/1925] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:05 2022] DELETE /identity/v3/projects/02a9b01602f64b3d9f14af52643dd688 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:05.235002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.235543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.236263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.257032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:05.258386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.324011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 947/1926] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:05.332615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.333010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.333292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.354154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:05.355482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.365586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 980/1927] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:05.370216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.380988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1ac54-98ac-4999-9ba9-e946915f008a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.385579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.386177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.386455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.386722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.387402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:05.387704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.389284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.401067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 948/1928] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:05.405403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.414784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98448b34-43e5-490e-8cae-be029b4f5939 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.419488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.420075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.420353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.420622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.421248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.423169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.453990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 981/1929] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:05.459597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.470376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884c54f-851b-4822-9dd5-97746a28fda9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.533978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.534585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.534864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.535139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.535780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.537720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.545854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.561470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 949/1930] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:05.565530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.573259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:05.580451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db013c98-ed69-47ef-a92e-15ce1c1a9d2f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.585651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.586263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.586546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.586825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.587713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.589575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.605599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 982/1931] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:05.609598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.620925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8b1d-1345-4803-8e0f-2a40ed76e644 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.627554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.628273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.628659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.628954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.629671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.631391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2e823-474d-4cf2-bfd9-be0dde54e627 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.643844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 950/1932] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:05.647288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.658122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887461d-139e-4e7b-bc4c-dc157c1bf2d7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.664359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.665140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.665847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.666193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] PATH_INFO: `/v3/projects/05d712f5c20e41f699f43f763a695681/users/daa7015ec3104a7d83002d75f6325d94/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.682307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d712f5c20e41f699f43f763a695681, user_id=daa7015ec3104a7d83002d75f6325d94, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.685049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.700374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 983/1933] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:05 2022] PUT /identity/v3/projects/05d712f5c20e41f699f43f763a695681/users/daa7015ec3104a7d83002d75f6325d94/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:05.711300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.711589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.711890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.740619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] MFA Rules not processed for user `daa7015ec3104a7d83002d75f6325d94`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:05.741823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.803831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 951/1934] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:05.839689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.841470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:05.896462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef5225-bc20-4103-b7a4-8c6075b56db7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:05.899952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:05.900539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:05.900811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:05.901079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:05.909687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:05.911089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f44c9-21ce-4c32-897f-a3875d773c81 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:05.919594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 984/1935] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:05.935077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:05.996467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80e753-2f17-45e3-9bdf-725bb1e7ccb3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.001694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.002326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.002601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.002869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] PATH_INFO: `/v3/users/daa7015ec3104a7d83002d75f6325d94` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.004016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa7015ec3104a7d83002d75f6325d94)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.005944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.049993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa7015ec3104a7d83002d75f6325d94'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.056939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa7015ec3104a7d83002d75f6325d94'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.063582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa7015ec3104a7d83002d75f6325d94'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.069120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.076953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa7015ec3104a7d83002d75f6325d94'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.077627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa7015ec3104a7d83002d75f6325d94'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.084537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 952/1936] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:05 2022] DELETE /identity/v3/users/daa7015ec3104a7d83002d75f6325d94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:06.088907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.089189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.089454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.109445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:06.111176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.175309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 985/1937] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:06.184886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.186303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.246127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8707c9-ffd2-4668-917c-65617b5cbc71 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.249849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.250455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.250731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.251010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.261266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.262697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f8905-f4ac-4e5d-9688-9809fbf35d97 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.273297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 953/1938] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:06.552781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.554256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.566044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54838f-ea45-4469-adfb-98683f149e62 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.570755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.571413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.571693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.571964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] PATH_INFO: `/v3/projects/05d712f5c20e41f699f43f763a695681` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.573074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d712f5c20e41f699f43f763a695681)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.575010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.623057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d712f5c20e41f699f43f763a695681', 'request_id': 'req-db22ff96-7725-4c52-b547-80dab9893e70'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.629936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d712f5c20e41f699f43f763a695681', 'request_id': 'req-db22ff96-7725-4c52-b547-80dab9893e70'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.636114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d712f5c20e41f699f43f763a695681', 'request_id': 'req-db22ff96-7725-4c52-b547-80dab9893e70'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.639705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:06.650385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] The token cache is being invalidate because project 05d712f5c20e41f699f43f763a695681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:06.651168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.652004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db22ff96-7725-4c52-b547-80dab9893e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:06.653968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 986/1939] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:06 2022] DELETE /identity/v3/projects/05d712f5c20e41f699f43f763a695681 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:06.659636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.659925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.660204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.679861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:06.680994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.781566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 954/1940] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:06.789042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.789376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.789654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.815817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:06.817000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:06.826021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 987/1941] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:06.831124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.840977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efddc8-900e-47d6-b57b-5dc51d936ed6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.845716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.846320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.846595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.846864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.847539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:06.847840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.849956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.861467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 955/1942] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:06.865558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.874651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a738a-caf7-4a91-b1ba-f7a808f4aba0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.880359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.880954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.881224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.881486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.882107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.884076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:06.911786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 988/1943] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:06.915828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:06.926427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df4f7-394c-4d0a-a5f9-17ef3b19a333 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:06.988731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:06.989352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:06.989627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:06.989894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:06.990513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:06.992456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.012459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 956/1944] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:06 2022] POST /identity/v3/users => generated 281 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:07.016604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:07.026696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee9ac-5658-4a1a-bb9a-bd56838f2248 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.031260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.031859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.032132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.032419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.033537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.035117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.045186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 989/1945] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:07.049493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:07.059947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d14d44-6778-4ed1-8656-64fefefd5654 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.064932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.065535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.065808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.066073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.066705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.068313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509551d-1673-4801-8791-977d4f32da1a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.069718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:07.080720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 957/1946] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:07.085107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:07.095796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446c19f-e1e9-48e8-8b69-7fe41cf4197a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.101799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.102521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.102964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.103234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] PATH_INFO: `/v3/projects/531e98e8bef241a4b7fc33f7a249cfaa/users/eca79f25734244929cd9fd7d8fd824a0/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.119169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=531e98e8bef241a4b7fc33f7a249cfaa, user_id=eca79f25734244929cd9fd7d8fd824a0, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.121885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.134196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 990/1947] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:07 2022] PUT /identity/v3/projects/531e98e8bef241a4b7fc33f7a249cfaa/users/eca79f25734244929cd9fd7d8fd824a0/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:07.144954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.145236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.145507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.172758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] MFA Rules not processed for user `eca79f25734244929cd9fd7d8fd824a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:07.174467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:07.237217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 958/1948] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:07.248483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:07.250179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:07.307559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e166e-48f3-4391-948b-86aab770e552 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:07.311528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:07.312134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:07.312408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:07.312673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:07.321433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:07.322856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d1585-e0fc-43f9-b11d-bd9848842fcd service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:07.332112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 991/1949] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:15.508152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.509598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:15.633889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68becbee-fb7c-4b15-9221-6204fa9d9eaa None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.648912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.649775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.650250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.650591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] PATH_INFO: `/v3/users/92419753bb1d43a8b4e7dd99ca95cd57` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.652686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=92419753bb1d43a8b4e7dd99ca95cd57)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.654701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.721128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92419753bb1d43a8b4e7dd99ca95cd57'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.728903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92419753bb1d43a8b4e7dd99ca95cd57'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.736385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92419753bb1d43a8b4e7dd99ca95cd57'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.748827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92419753bb1d43a8b4e7dd99ca95cd57'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.749479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92419753bb1d43a8b4e7dd99ca95cd57'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.756473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 959/1950] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:15 2022] DELETE /identity/v3/users/92419753bb1d43a8b4e7dd99ca95cd57 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:15.760928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.761425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.761514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.780858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:15.782175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:15.792378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.793776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:15.800350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:15.843713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 992/1951] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:15.853770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:15.855083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:15.861313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828690e2-2789-474f-8b35-a19e8a1d25ff admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.865884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.866502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.866777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.867052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] PATH_INFO: `/v3/users/ebf8abf46245432f889c3610233e8e79` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.868181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf8abf46245432f889c3610233e8e79)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.870073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.894727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:15.916051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c48256-5431-4181-babb-3eecb58a4455 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:15.918128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf8abf46245432f889c3610233e8e79'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.919886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:15.920491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.920772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.921043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.925656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf8abf46245432f889c3610233e8e79'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.930285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:15.931757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb35ea-771f-4eac-8ce2-e67e5825c855 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:15.933155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf8abf46245432f889c3610233e8e79'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.941580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 993/1952] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:15.945811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf8abf46245432f889c3610233e8e79'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.946482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf8abf46245432f889c3610233e8e79'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:15.952419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 960/1953] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:15 2022] DELETE /identity/v3/users/ebf8abf46245432f889c3610233e8e79 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:15.957095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:15.957402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:15.957680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:15.976525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:15.977723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.064627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 994/1954] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:16.074583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.076014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.138278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599beee-9460-4104-90cb-8051a7f0779b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.142436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.143041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.143337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.143605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.152976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:16.154392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:16.167797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 961/1955] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:16.447074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.448638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.465375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7326c-4eea-4005-bdc9-8a615574f37c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.472322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.473104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.473444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.474018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] PATH_INFO: `/v3/projects/71d77ac51b8c49af827a3e02fe93f04b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.475839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d77ac51b8c49af827a3e02fe93f04b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:16.478739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:16.500193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.502331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.520013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5ebde-305f-4831-b207-ceb4d2663fda service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.524971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.526360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.526645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.526899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] PATH_INFO: `/v3/projects/0e84a0691d9a48968252202ba14efab3` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.528399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e84a0691d9a48968252202ba14efab3)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:16.530318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:16.542115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d77ac51b8c49af827a3e02fe93f04b', 'request_id': 'req-ca80b4a1-dfed-4312-841d-e7be28e13c6b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.547570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d77ac51b8c49af827a3e02fe93f04b', 'request_id': 'req-ca80b4a1-dfed-4312-841d-e7be28e13c6b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.553986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d77ac51b8c49af827a3e02fe93f04b', 'request_id': 'req-ca80b4a1-dfed-4312-841d-e7be28e13c6b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.554787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.568282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] The token cache is being invalidate because project 71d77ac51b8c49af827a3e02fe93f04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:16.568570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.569207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.570699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 995/1956] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:16 2022] DELETE /identity/v3/projects/71d77ac51b8c49af827a3e02fe93f04b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:16.574503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.575856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.581702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e84a0691d9a48968252202ba14efab3', 'request_id': 'req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.587436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e84a0691d9a48968252202ba14efab3', 'request_id': 'req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.593687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e84a0691d9a48968252202ba14efab3', 'request_id': 'req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.613358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] The token cache is being invalidate because project 0e84a0691d9a48968252202ba14efab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:16.613718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.614354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.616168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 962/1957] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:16 2022] DELETE /identity/v3/projects/0e84a0691d9a48968252202ba14efab3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:16.619778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:16.621170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:16.644183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80b4a1-dfed-4312-841d-e7be28e13c6b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.649351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:16.699592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f53b-c5d7-4852-877d-b669a7f6a5a3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:16.714021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.714785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.714929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.715200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] PATH_INFO: `/v3/users/820650d5107748b8914e5da01e34d17d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.716603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820650d5107748b8914e5da01e34d17d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:16.718590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:16.746722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:16.747384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:16.747697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:16.748102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] PATH_INFO: `/v3/users/d1ef386053ba460aaa88e6c01355099e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:16.749374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ef386053ba460aaa88e6c01355099e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:16.752559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:16.773415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820650d5107748b8914e5da01e34d17d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.787895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820650d5107748b8914e5da01e34d17d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.801370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820650d5107748b8914e5da01e34d17d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.816633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ef386053ba460aaa88e6c01355099e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.817210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820650d5107748b8914e5da01e34d17d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.817972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820650d5107748b8914e5da01e34d17d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.824171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ef386053ba460aaa88e6c01355099e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.825183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 963/1958] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:16 2022] DELETE /identity/v3/users/820650d5107748b8914e5da01e34d17d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:16.833937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ef386053ba460aaa88e6c01355099e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.834690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ef386053ba460aaa88e6c01355099e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.849503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ef386053ba460aaa88e6c01355099e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:16.856237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 996/1959] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:16 2022] DELETE /identity/v3/users/d1ef386053ba460aaa88e6c01355099e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:17.185233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.186785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.232854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.234407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.254863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.295761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f61861-29db-4f59-8a08-535dc5049599 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.318334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e401d9-82a4-4766-a670-76eee737aa6b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.324194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.325142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.325319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.327072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] PATH_INFO: `/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.327072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7f0f56e03d4414ab2c52a30d381d8f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.328966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.369744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.370417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.370694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.370962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] PATH_INFO: `/v3/projects/1551acb67e2a491bb576373cf9804e7a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.372130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1551acb67e2a491bb576373cf9804e7a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.374044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.381533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.398790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7f0f56e03d4414ab2c52a30d381d8f', 'request_id': 'req-356a408f-8060-402e-96bd-a2f0e544a286'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.406287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7f0f56e03d4414ab2c52a30d381d8f', 'request_id': 'req-356a408f-8060-402e-96bd-a2f0e544a286'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.414387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7f0f56e03d4414ab2c52a30d381d8f', 'request_id': 'req-356a408f-8060-402e-96bd-a2f0e544a286'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.430055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] The token cache is being invalidate because project 9a7f0f56e03d4414ab2c52a30d381d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:17.430349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.430971 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-356a408f-8060-402e-96bd-a2f0e544a286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.432286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1551acb67e2a491bb576373cf9804e7a', 'request_id': 'req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.433603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 997/1960] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:17 2022] DELETE /identity/v3/projects/9a7f0f56e03d4414ab2c52a30d381d8f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:17.438287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d831-d581-48e6-9a20-fc1ae98fe089 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.438627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d831-d581-48e6-9a20-fc1ae98fe089 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.438898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d831-d581-48e6-9a20-fc1ae98fe089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.439632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1551acb67e2a491bb576373cf9804e7a', 'request_id': 'req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.449184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1551acb67e2a491bb576373cf9804e7a', 'request_id': 'req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.458947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6d41d831-d581-48e6-9a20-fc1ae98fe089 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:17.460175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6d41d831-d581-48e6-9a20-fc1ae98fe089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.467857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] The token cache is being invalidate because project 1551acb67e2a491bb576373cf9804e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:17.468151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.468794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-98f0ac0c-8a0d-4c07-a7f7-c30f0b99763e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:17.470823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 964/1961] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:17 2022] DELETE /identity/v3/projects/1551acb67e2a491bb576373cf9804e7a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:17.476964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fc46-a974-42f8-8259-d5bb5cef0901 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.478007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fc46-a974-42f8-8259-d5bb5cef0901 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.478424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fc46-a974-42f8-8259-d5bb5cef0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.503173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-6c27fc46-a974-42f8-8259-d5bb5cef0901 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:17.504662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6c27fc46-a974-42f8-8259-d5bb5cef0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.535472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 998/1962] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:17.541503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.542083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.542660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.566516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:17.567876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.577293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 999/1963] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:17.584336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.591391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 965/1964] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:17.593756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043494d9-a379-4a3b-b53d-016c56d18710 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.597406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.597686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.597960 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.602946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.603894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.604176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.604444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.605096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.605418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.607030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.613001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.619853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:17.621824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:17.624618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1000/1965] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:17.629833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.633191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 966/1966] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:17.637199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.639691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeff88-7436-4da2-b476-df876e34cab8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.644232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.644816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.645088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.645359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.645964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.646664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a65454-fb17-48cb-b533-f26b867d0286 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.647873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.651266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.651858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.652131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.652395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.653034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:17.653322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.654872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.667127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 967/1967] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:17.671783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.679081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1001/1968] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:17.680423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.681890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417be7a7-ab9d-48dd-88ab-35c8981216fc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.745091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.745229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28114b-6b9c-4d43-8c2f-2cff7f4a0cbd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.745706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.746099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.746464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.747096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.749025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.750665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.752010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.752286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.752553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.753203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.755717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.777527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 968/1969] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:17.781467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.787960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1002/1970] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:17.792164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.804218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaafda8-a532-448c-9272-f5d54ec72c78 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.807869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:17.844899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87da63-f634-470a-bc1c-f84420423d36 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.849866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.850464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.850748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.851016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.851664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.853571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.863276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.863897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.864179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.864448 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.865144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.866686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.874304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 969/1971] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:17 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:17.878383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1003/1972] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:17.878995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.882153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.888560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be454b-7fb2-41a9-8377-4f957b098432 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.892131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547abf5f-1b4d-46da-975c-0c783b53e5e8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.893152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.893742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.894022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.894292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.894921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.896574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.896793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.897383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.897657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.898031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.898544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.900148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.907552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 970/1973] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:17.911173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.916598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1004/1974] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:17.917585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.921791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa2fa6-eadf-407f-9531-412f94c666f4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.927804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.928186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa701da1-2c7d-40a1-9308-c7c2ac744506 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.928410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.928720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.928989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.929617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.931208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.940427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.941145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.941422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.941957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] PATH_INFO: `/v3/projects/f19870c7ae6f4545ab6c37091d83370d/users/7bb544e21e7240c99b438e2d9c2f8b7d/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.942071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 971/1975] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:17.945973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:17.956589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2402d56-6dff-436e-880c-db9e881e599c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:17.966935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:17.967643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:17.967919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:17.968193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] PATH_INFO: `/v3/projects/5b85a685a6844bc2ac3a2ba1aa75de9d/users/933f31b5361c400896f2b8688c5e1229/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:17.974138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19870c7ae6f4545ab6c37091d83370d, user_id=7bb544e21e7240c99b438e2d9c2f8b7d, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.977014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533c1c0-f5fd-4e54-bdd9-4970176c8c2a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:17.988875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b85a685a6844bc2ac3a2ba1aa75de9d, user_id=933f31b5361c400896f2b8688c5e1229, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:17.991553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a072-4c9c-483e-8c6c-7622a7a0879d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.002096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1005/1976] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:17 2022] PUT /identity/v3/projects/f19870c7ae6f4545ab6c37091d83370d/users/7bb544e21e7240c99b438e2d9c2f8b7d/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:18.013635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.013889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.014151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.019289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 972/1977] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:17 2022] PUT /identity/v3/projects/5b85a685a6844bc2ac3a2ba1aa75de9d/users/933f31b5361c400896f2b8688c5e1229/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:18.030865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.031235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.031703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.045989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] MFA Rules not processed for user `7bb544e21e7240c99b438e2d9c2f8b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:18.047209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.066396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] MFA Rules not processed for user `933f31b5361c400896f2b8688c5e1229`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:18.067634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.078404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.121816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1006/1978] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:18.126970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.152568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 973/1979] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:18.156970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.194136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.200114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89937871-1265-4ac6-9b35-c41553bd9e47 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.210410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.211034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.211351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.211625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.212248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.214259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.224552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fa138-3aae-45d3-ba8e-ba8a0997bf34 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.229170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.229777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.230057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.230326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.230941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.232859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.243600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1007/1980] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:18.247694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.265924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 974/1981] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:18.270310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.316741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0113d8-d59a-4fba-af11-8d5183357c92 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.331954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c0f20-cae2-4a7e-b5ef-ce1941d25de6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.337947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.338543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.338819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.339084 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.339731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.341614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.364077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 975/1982] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:18.367768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.374061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.374668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.374937 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.375199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.375867 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.377762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.377883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0451c-fd10-4dae-8e99-a70babaad184 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.382695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.383298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.383576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.383845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.384467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.386107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.397559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 976/1983] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:18.399624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1008/1984] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:18.401642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.404483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.411370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdfe7e-8893-40d4-9de3-b2582ee58658 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.414257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f431a-e986-4177-910b-3a9845921b31 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.416447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.417076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.417354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.417623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] PATH_INFO: `/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d/users/ca9ed9b3142345d493fb388767e7fef1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.419236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.419981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.420570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.420699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.420849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.421816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.424419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.434177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb34e80a0f44f4a8905d2f27cd43d8d, user_id=ca9ed9b3142345d493fb388767e7fef1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.435060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1009/1985] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:18.436867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.439751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.449741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2686b-c8ae-4b64-a8c8-7fae7f7c168b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.450089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 977/1986] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:18 2022] PUT /identity/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d/users/ca9ed9b3142345d493fb388767e7fef1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:18.454131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.507264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.507939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.508220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.508491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] PATH_INFO: `/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46/users/7e8dc6dff5194b5591d89a485adf022f/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.514999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f712a-bb19-4152-a34a-e4c7354dba27 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.520159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.520765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.521070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.521383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.521532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.522349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.524218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.524814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fc0e41fed403c8c88f66f4dbeeb46, user_id=7e8dc6dff5194b5591d89a485adf022f, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.527874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.534673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 978/1987] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:18.538867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.541657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1010/1988] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:18 2022] PUT /identity/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46/users/7e8dc6dff5194b5591d89a485adf022f/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:18.545358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.550575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38791687-1092-4307-9c00-2bc31ae4bf5c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.619004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.619714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.620121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.620404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] PATH_INFO: `/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d/users/ca9ed9b3142345d493fb388767e7fef1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.622378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb34e80a0f44f4a8905d2f27cd43d8d, user_id=ca9ed9b3142345d493fb388767e7fef1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.625249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25db9d-ae74-4369-b21c-6ae1150cea2d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.639305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 979/1989] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:18 2022] PUT /identity/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d/users/ca9ed9b3142345d493fb388767e7fef1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:18.640887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa6b34-5482-4ecf-be74-59968c90b9bc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.647527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.647814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.648110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.679922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] MFA Rules not processed for user `ca9ed9b3142345d493fb388767e7fef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:18.681159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.704379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.704996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.705525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.706787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.706915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.708908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.719368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1011/1990] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:18.723871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.736572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ae358-0fc1-4322-9c1f-17a05ee4aadd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.742319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.742977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.743269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.743567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] PATH_INFO: `/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46/users/7e8dc6dff5194b5591d89a485adf022f/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.745750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188fc0e41fed403c8c88f66f4dbeeb46, user_id=7e8dc6dff5194b5591d89a485adf022f, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.748336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6050-db31-4094-bb7c-3218fbc51560 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.757913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.761476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1012/1991] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:18 2022] PUT /identity/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46/users/7e8dc6dff5194b5591d89a485adf022f/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:18.768630 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 980/1992] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:18.772017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.772376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.772777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.777525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.778990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.804067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] MFA Rules not processed for user `7e8dc6dff5194b5591d89a485adf022f`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:18.805367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.867275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27172180-2c0b-4317-bd5e-a68894590ad1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.880287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1013/1993] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:18.891180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:18.892617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:18.901761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:18.927850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.928465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.928742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.929011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.953365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e066e-127a-47f2-8838-72172beb7294 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:18.957882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:18.958488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:18.958767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:18.959038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:18.968052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.969495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:18.978907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1014/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:18.990676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:18.992133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.002247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 981/1995] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:19.460585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:19.529672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93067140-7d94-43d9-a4bd-5c2ccd700de9 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:19.530523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:19.534980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:19.535790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.536078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.536354 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] PATH_INFO: `/v3/users/7bb544e21e7240c99b438e2d9c2f8b7d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.537490 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb544e21e7240c99b438e2d9c2f8b7d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:19.539552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.541462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121b06-8e60-4516-9b2d-a584ac5940c1 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:19.546041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:19.546651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.546929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.547198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] PATH_INFO: `/v3/users/933f31b5361c400896f2b8688c5e1229` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.548406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=933f31b5361c400896f2b8688c5e1229)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:19.550315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.601878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb544e21e7240c99b438e2d9c2f8b7d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.604764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb544e21e7240c99b438e2d9c2f8b7d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.610024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933f31b5361c400896f2b8688c5e1229'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.615816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb544e21e7240c99b438e2d9c2f8b7d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.616613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb544e21e7240c99b438e2d9c2f8b7d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.618173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933f31b5361c400896f2b8688c5e1229'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.623775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:19.626077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933f31b5361c400896f2b8688c5e1229'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.631416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62e6c413-cb46-4bb0-9804-16bb773c1439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb544e21e7240c99b438e2d9c2f8b7d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.644836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933f31b5361c400896f2b8688c5e1229'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.645300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1015/1996] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:19 2022] DELETE /identity/v3/users/7bb544e21e7240c99b438e2d9c2f8b7d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:19.646074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cf75724e-ca0b-46fc-9138-0a3c983ee30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933f31b5361c400896f2b8688c5e1229'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:19.649686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.649976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.650254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.653705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 982/1997] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:19 2022] DELETE /identity/v3/users/933f31b5361c400896f2b8688c5e1229 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:19.658871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.660289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.660739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.671019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:19.672397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:19.696546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:19.702594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:19.710179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:19.756886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1016/1998] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:19.763676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:19.765360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:19.794939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 983/1999] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:19.806787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:19.808619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:19.857316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a25e5-26f7-4c53-a6eb-f8f8672c228e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:19.870728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:19.871820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.872326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.872708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.900319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:19.901782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.911051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09724cbf-4eef-4fc6-a0c2-d432f8ebda72 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:19.916309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:19.917125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:19.917552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:19.918070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:19.930177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:19.932446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:19.935367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1017/2000] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:19.945747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 984/2001] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:20.253583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.255143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:20.270008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb185c3-7abe-44c1-8ba2-240cbde1fd96 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.275390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.276240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.276533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.276806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] PATH_INFO: `/v3/projects/f19870c7ae6f4545ab6c37091d83370d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.277952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19870c7ae6f4545ab6c37091d83370d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.279913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.343323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19870c7ae6f4545ab6c37091d83370d', 'request_id': 'req-b29bb704-8695-48ec-9961-5492916ce5a9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.349659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19870c7ae6f4545ab6c37091d83370d', 'request_id': 'req-b29bb704-8695-48ec-9961-5492916ce5a9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.356586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19870c7ae6f4545ab6c37091d83370d', 'request_id': 'req-b29bb704-8695-48ec-9961-5492916ce5a9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.371433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] The token cache is being invalidate because project f19870c7ae6f4545ab6c37091d83370d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:20.371743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.372447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.374191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1018/2002] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:20 2022] DELETE /identity/v3/projects/f19870c7ae6f4545ab6c37091d83370d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:20.378726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.388906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c765-4186-43ad-b476-5286027b2f17 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.477650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.478437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.479450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.479882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] PATH_INFO: `/v3/users/7e8dc6dff5194b5591d89a485adf022f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.482541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8dc6dff5194b5591d89a485adf022f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.500104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.532871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.563132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8dc6dff5194b5591d89a485adf022f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.575588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8dc6dff5194b5591d89a485adf022f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.595696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8dc6dff5194b5591d89a485adf022f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.622284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.622742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8dc6dff5194b5591d89a485adf022f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.623885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:20.624340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8dc6dff5194b5591d89a485adf022f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.639095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 985/2003] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:20 2022] DELETE /identity/v3/users/7e8dc6dff5194b5591d89a485adf022f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:20.640692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb704-8695-48ec-9961-5492916ce5a9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:20.758664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:20.779228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:20.779930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:20.780205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:20.780480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] PATH_INFO: `/v3/projects/5b85a685a6844bc2ac3a2ba1aa75de9d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:20.781725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b85a685a6844bc2ac3a2ba1aa75de9d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:20.784090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:20.844475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b85a685a6844bc2ac3a2ba1aa75de9d', 'request_id': 'req-a171cf64-bd4f-4c1e-8597-9a62f46af14b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.851083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b85a685a6844bc2ac3a2ba1aa75de9d', 'request_id': 'req-a171cf64-bd4f-4c1e-8597-9a62f46af14b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.862868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b85a685a6844bc2ac3a2ba1aa75de9d', 'request_id': 'req-a171cf64-bd4f-4c1e-8597-9a62f46af14b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.880250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] The token cache is being invalidate because project 5b85a685a6844bc2ac3a2ba1aa75de9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:20.880441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.881226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:20.882847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1019/2004] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:20 2022] DELETE /identity/v3/projects/5b85a685a6844bc2ac3a2ba1aa75de9d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:20.886654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:20.888188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:20.911734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa2ba8-431b-4e1e-9418-0fc988bc516a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.033565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.034299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.034661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.035519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] PATH_INFO: `/v3/users/ca9ed9b3142345d493fb388767e7fef1` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.037309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9ed9b3142345d493fb388767e7fef1)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.039502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.099538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9ed9b3142345d493fb388767e7fef1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.111361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9ed9b3142345d493fb388767e7fef1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.119673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9ed9b3142345d493fb388767e7fef1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.127467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.131057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.139671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9ed9b3142345d493fb388767e7fef1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.140483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6a169073-5d6d-4e97-91c4-5c44aa0cfd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9ed9b3142345d493fb388767e7fef1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.148687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 986/2005] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:20 2022] DELETE /identity/v3/users/ca9ed9b3142345d493fb388767e7fef1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:21.160425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171cf64-bd4f-4c1e-8597-9a62f46af14b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.223376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.223946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.224514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.224655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] PATH_INFO: `/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.225897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188fc0e41fed403c8c88f66f4dbeeb46)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.227955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.277613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188fc0e41fed403c8c88f66f4dbeeb46', 'request_id': 'req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.283700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188fc0e41fed403c8c88f66f4dbeeb46', 'request_id': 'req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.290079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188fc0e41fed403c8c88f66f4dbeeb46', 'request_id': 'req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.305313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] The token cache is being invalidate because project 188fc0e41fed403c8c88f66f4dbeeb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:21.307491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.308264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b48b4eb5-625d-4e86-874d-9a9a4ce928b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.310650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1020/2006] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:21 2022] DELETE /identity/v3/projects/188fc0e41fed403c8c88f66f4dbeeb46 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:21.315959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.316260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.316509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.337717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:21.339210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.354501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:21.430658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 987/2007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:21.434736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.437235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.439438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.472225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.479285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.505459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01986f-41d9-4ede-a408-57a1ee4bda9d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.507074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:21.508626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.529720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.532097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.532386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.532660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] PATH_INFO: `/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.536002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb34e80a0f44f4a8905d2f27cd43d8d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.540164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.543210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1021/2008] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:21.544399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.556881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85729-0c42-424e-af97-40223cbb9d42 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.564271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.565586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.565920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.566347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.567551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:21.568051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.570119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.573656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:21.605020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1022/2009] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:21.609388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.612805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb34e80a0f44f4a8905d2f27cd43d8d', 'request_id': 'req-a8cd8307-96e3-4418-9754-3e55e01fad4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.619989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb34e80a0f44f4a8905d2f27cd43d8d', 'request_id': 'req-a8cd8307-96e3-4418-9754-3e55e01fad4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.627786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb34e80a0f44f4a8905d2f27cd43d8d', 'request_id': 'req-a8cd8307-96e3-4418-9754-3e55e01fad4e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.643234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] The token cache is being invalidate because project 6cb34e80a0f44f4a8905d2f27cd43d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:21.644089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.644278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a8cd8307-96e3-4418-9754-3e55e01fad4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:21.646394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 988/2010] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:21 2022] DELETE /identity/v3/projects/6cb34e80a0f44f4a8905d2f27cd43d8d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:21.649644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee8e96-4248-4e70-9726-f739ab5c0f73 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.650793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8161-7c1f-498f-8394-81df6c31d50b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.651071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8161-7c1f-498f-8394-81df6c31d50b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.651390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e8161-7c1f-498f-8394-81df6c31d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.672111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-599e8161-7c1f-498f-8394-81df6c31d50b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:21.673853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-599e8161-7c1f-498f-8394-81df6c31d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.744563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.745254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 989/2011] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:21.745388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.745585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.745696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.746375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.748451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.753936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.754303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.754635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.779741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:21.780898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1023/2012] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:21.781446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.785446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.787091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:21.841121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:21.864398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e9d7e-2876-4e8f-82ae-aa2b836ac643 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.870061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 990/2013] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:21.874291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.880795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.881716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.882164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.882588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.883434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.885069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d22be-7d1c-4997-8c5a-bb0bca813789 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.885503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.890539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.891095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.891556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.891828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.892628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:21.892934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.894623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.909670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 991/2014] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:21.912097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1024/2015] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:21.914228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.916208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.927626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652c149-aa89-4562-8fe9-9cc54eb30d1c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.928798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbdc68-e438-4d2a-af32-0763b3cd51f3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.932712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.933621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.933904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.934167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.934516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.934782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.935683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.936104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.936534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.937415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.939740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.942638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.951793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1025/2016] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:21.956110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.967306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb884cd-d783-4a06-9adb-7f746a000d9c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:21.973123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:21.974135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:21.974637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:21.974977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:21.975842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:21.977612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:21.982910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 992/2017] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:21.985673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:21.996929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1026/2018] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:22.001636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.017472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466efcfc-fd0f-4991-85fa-6091c9c0b0f4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.060290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a6da-77fa-44e2-a982-966af4d457ac admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.065463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.066062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.066338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.066610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.067213 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.069112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:22.069223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.082586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.083270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.083565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.083919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] PATH_INFO: `/v3/projects/5e41db85608e4dfb9015472bbac82657/users/b87c0de5cae044ac93a0e9bb49d6290b/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.091858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 993/2019] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:21 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:22.096045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.098801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e41db85608e4dfb9015472bbac82657, user_id=b87c0de5cae044ac93a0e9bb49d6290b, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.101677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4bdec-ed7b-4447-a4e8-58a2977acc02 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.105508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4b561-6be8-4c7a-9b0b-c48023747e94 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.111133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.111766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.112024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.112286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.112910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.114469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.116305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1027/2020] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:21 2022] PUT /identity/v3/projects/5e41db85608e4dfb9015472bbac82657/users/b87c0de5cae044ac93a0e9bb49d6290b/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:22.127496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.131052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.131131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 994/2021] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:22.131206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.131790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.141524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2818ae2-ef3d-49c4-8ad8-b52d7c227f04 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.155788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] MFA Rules not processed for user `b87c0de5cae044ac93a0e9bb49d6290b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:22.157001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:22.196920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.197532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.197817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.198091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.198730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.200345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.211182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 995/2022] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:22.215388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.225529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1028/2023] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:22.226834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7622b8-253b-400c-8180-7e31e4126763 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.229966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.231678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.232347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.232606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.232874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] PATH_INFO: `/v3/projects/983f4b6f7711433fb16502261b4b27a4/users/d79b7dca6b234185b7a3e1fbdfee118e/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.240905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea98549-29dc-4fb6-a5aa-4d40568843b1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.245972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.246986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.247388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.247756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.248513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.249294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] RBAC: Authorizing `identity:create_grant(project_id=983f4b6f7711433fb16502261b4b27a4, user_id=d79b7dca6b234185b7a3e1fbdfee118e, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.250487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.252158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123dbc9-801c-47e6-9b65-f82bf78f435e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.262578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:22.267937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 996/2024] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:22 2022] PUT /identity/v3/projects/983f4b6f7711433fb16502261b4b27a4/users/d79b7dca6b234185b7a3e1fbdfee118e/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:22.279957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.280247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.280520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.286380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1029/2025] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:22.287111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.314303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] MFA Rules not processed for user `d79b7dca6b234185b7a3e1fbdfee118e`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:22.315671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:22.375644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88dfd5-ecb4-446e-ac00-ad791579a781 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.380592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.381197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.381476 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.381752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.382422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.384320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.391923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 997/2026] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:22.404005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.405394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:22.409806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1030/2027] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:22.413762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.424273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39f771-0948-4db5-af98-8cdfb98b09dc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.428966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.429545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.429820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.430087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.430712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.432310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.442801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1031/2028] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:22.446432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.456043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bd69-e226-4fea-b002-073ecde56aa4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.460647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.461219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.461495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.461839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.462379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.463973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.466923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a3b6-c51a-4839-9c10-616c6399358a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.471589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.472189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.472463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.472729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.474681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1032/2029] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:22.478621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.482658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.484127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aea3a1-6753-494a-a439-763bdf5e8e1e service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.488868 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09846-a4e2-43c5-aa08-624c08859e83 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.493928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.494715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.494855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.495124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] PATH_INFO: `/v3/projects/dbf153a136af41fa82e21d341f8db60e/users/c1476f6c06f942deb995bfb9f3567e9d/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.497959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:22.499575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 998/2030] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:38:22.516037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf153a136af41fa82e21d341f8db60e, user_id=c1476f6c06f942deb995bfb9f3567e9d, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.518951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.535518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1033/2031] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:22 2022] PUT /identity/v3/projects/dbf153a136af41fa82e21d341f8db60e/users/c1476f6c06f942deb995bfb9f3567e9d/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:22.547359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.548401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.548676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.591666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] MFA Rules not processed for user `c1476f6c06f942deb995bfb9f3567e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:22.593236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:22.709541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 999/2032] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:22.714848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.851675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c3f6c-c15b-4381-8d81-8ade848dd1a4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.862973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:22.863750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:22.864027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:22.864292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:22.864918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:22.867332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:22.912101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1034/2033] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:22.913403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:22.929877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de972c-fb22-4e82-95d8-0aa9e23a568a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:22.986185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:23.044792 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.045808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.046204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.046657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.047988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.050484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.079591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1000/2034] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:22 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:23.084071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.097028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0c54-76d3-4cbc-a521-91507fd4dfb5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.102677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.102966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.103382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.103750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.104545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.106336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.120558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1035/2035] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:23.126464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.138575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4df5d4-d611-4c13-8c02-026fe2e28935 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.144066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.145088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.145514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.145890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] PATH_INFO: `/v3/projects/858db19d2239483ead75852c35fb7b99/users/82cd864f98eb43d5b8401b10c4851524/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.162934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858db19d2239483ead75852c35fb7b99, user_id=82cd864f98eb43d5b8401b10c4851524, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.165684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.181434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1001/2036] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:23 2022] PUT /identity/v3/projects/858db19d2239483ead75852c35fb7b99/users/82cd864f98eb43d5b8401b10c4851524/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:23.185529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.197968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00615af4-ea82-4687-a815-ed1296710e46 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.258811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.259478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.259757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.260004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.260639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.262219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6141af7-6f07-4f87-9977-6e8ebc37eca8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.273318 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1036/2037] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:23.277618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.288373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743c67f-9499-48f1-b2e9-01c435d13258 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.293276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.294099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.294380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.294681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] PATH_INFO: `/v3/projects/858db19d2239483ead75852c35fb7b99/users/82cd864f98eb43d5b8401b10c4851524/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.296754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858db19d2239483ead75852c35fb7b99, user_id=82cd864f98eb43d5b8401b10c4851524, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.301003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.321481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1002/2038] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:23 2022] PUT /identity/v3/projects/858db19d2239483ead75852c35fb7b99/users/82cd864f98eb43d5b8401b10c4851524/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:23.332997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.333451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.333727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.365618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] MFA Rules not processed for user `82cd864f98eb43d5b8401b10c4851524`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:23.366864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:23.408586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:23.437549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1037/2039] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:23.448577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.450456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:23.511233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0964f-39c3-451d-9562-8dfb1810b732 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.515489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.516090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.516900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.517172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.526819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.528680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.539338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1003/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:23.590596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:23.602285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c739b-f0d2-4965-b5ee-ecd7a29d9229 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:23.607834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:23.608832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:23.609222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:23.619464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:23.679477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:23.681102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce48324-a6c3-41d2-8546-c7a07afe434f service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:23.690509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1038/2041] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:33.534707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:33.686566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=38 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:54.402805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.477977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0df79d-461f-4bb5-9795-00fe3713c9de service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.483185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.483859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.484662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.484936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] PATH_INFO: `/v3/users/b87c0de5cae044ac93a0e9bb49d6290b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.486248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87c0de5cae044ac93a0e9bb49d6290b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.488330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.553434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87c0de5cae044ac93a0e9bb49d6290b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:54.566186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87c0de5cae044ac93a0e9bb49d6290b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:54.576599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87c0de5cae044ac93a0e9bb49d6290b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:54.601242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87c0de5cae044ac93a0e9bb49d6290b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:54.601242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87c0de5cae044ac93a0e9bb49d6290b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:54.611593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1004/2042] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:54 2022] DELETE /identity/v3/users/b87c0de5cae044ac93a0e9bb49d6290b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:54.613746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.614265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.614358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.660771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:54.663112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:54.764100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1039/2043] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:54.777589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:54.779118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:54.927089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e624fa2-3f01-4aed-954e-cc49fb27a7a3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:54.932338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:54.933229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:54.933790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:54.934130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:54.956506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:54.958093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:54.992756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1005/2044] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:55.455170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.457768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:55.503309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64771b7-6000-48c4-8ff2-5fdd6699c57e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.517683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.518507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.518885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.519387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] PATH_INFO: `/v3/projects/5e41db85608e4dfb9015472bbac82657` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.520684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e41db85608e4dfb9015472bbac82657)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.522795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.613713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e41db85608e4dfb9015472bbac82657', 'request_id': 'req-e0a15990-4d36-49a5-bf31-229ab16295d0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.620542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e41db85608e4dfb9015472bbac82657', 'request_id': 'req-e0a15990-4d36-49a5-bf31-229ab16295d0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.628133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e41db85608e4dfb9015472bbac82657', 'request_id': 'req-e0a15990-4d36-49a5-bf31-229ab16295d0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.643686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] The token cache is being invalidate because project 5e41db85608e4dfb9015472bbac82657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:55.644054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.644753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.646589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1040/2045] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:55 2022] DELETE /identity/v3/projects/5e41db85608e4dfb9015472bbac82657 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:55.650680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:55.662351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db391-92ed-4ae7-996f-f12aae9429b6 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:55.684482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:55.733133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:55.734298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:55.734766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:55.735205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] PATH_INFO: `/v3/users/c1476f6c06f942deb995bfb9f3567e9d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:55.736889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1476f6c06f942deb995bfb9f3567e9d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:55.738811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:55.815172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1476f6c06f942deb995bfb9f3567e9d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.826249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1476f6c06f942deb995bfb9f3567e9d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.838255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1476f6c06f942deb995bfb9f3567e9d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.855001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1476f6c06f942deb995bfb9f3567e9d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.856176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1476f6c06f942deb995bfb9f3567e9d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:55.868703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1006/2046] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:55 2022] DELETE /identity/v3/users/c1476f6c06f942deb995bfb9f3567e9d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:56.202102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.205443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:56.234137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a15990-4d36-49a5-bf31-229ab16295d0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.394024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.394574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.394871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.395142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] PATH_INFO: `/v3/projects/dbf153a136af41fa82e21d341f8db60e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.396325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf153a136af41fa82e21d341f8db60e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.398298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.431856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.451062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf153a136af41fa82e21d341f8db60e', 'request_id': 'req-e197166b-26c4-4e5f-bd4a-dc46addea14d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.457136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf153a136af41fa82e21d341f8db60e', 'request_id': 'req-e197166b-26c4-4e5f-bd4a-dc46addea14d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.464335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf153a136af41fa82e21d341f8db60e', 'request_id': 'req-e197166b-26c4-4e5f-bd4a-dc46addea14d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.480874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] The token cache is being invalidate because project dbf153a136af41fa82e21d341f8db60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:56.481168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.481829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.483569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1041/2047] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:56 2022] DELETE /identity/v3/projects/dbf153a136af41fa82e21d341f8db60e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:56.488244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.489767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:56.502978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef4cb-9403-439e-860a-cd988e763d68 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.568047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:56.568880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:56.607943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.608593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.608875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.609752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] PATH_INFO: `/v3/users/82cd864f98eb43d5b8401b10c4851524` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.614520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cd864f98eb43d5b8401b10c4851524)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.616758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.745158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197166b-26c4-4e5f-bd4a-dc46addea14d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:56.754811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:56.758171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:56.768063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:56.768975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] PATH_INFO: `/v3/users/cfc723ea96524b8fb91c2a53b3934225` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:56.772468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc723ea96524b8fb91c2a53b3934225)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:56.778298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:56.786146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:56.798916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cd864f98eb43d5b8401b10c4851524'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.837020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cd864f98eb43d5b8401b10c4851524'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.873699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cd864f98eb43d5b8401b10c4851524'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.889262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cd864f98eb43d5b8401b10c4851524'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.891220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f1a7f5f-2737-449c-9af1-71247a6e9885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cd864f98eb43d5b8401b10c4851524'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:56.901506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1007/2048] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:56 2022] DELETE /identity/v3/users/82cd864f98eb43d5b8401b10c4851524 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:57.000612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc723ea96524b8fb91c2a53b3934225'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:57.013898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc723ea96524b8fb91c2a53b3934225'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:57.029334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc723ea96524b8fb91c2a53b3934225'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:57.034487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc723ea96524b8fb91c2a53b3934225'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:57.060055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc723ea96524b8fb91c2a53b3934225'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:57.073556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1042/2049] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:56 2022] DELETE /identity/v3/users/cfc723ea96524b8fb91c2a53b3934225 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:57.079307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.079894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.081604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.136634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:57.138472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:57.256225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1008/2050] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:57.265282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.267206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:57.321026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:57.368384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b138d-9bf3-49dc-829a-14527c3cf1a1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:57.389551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:57.391437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:57.391721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:57.392043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:57.404131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:57.405936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc06ec-8131-4723-819d-144547eea326 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:57.430496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1043/2051] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:57.997195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:57.998716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.011957 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0daf-dc9a-4bbc-83c4-73c61a5f113a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.017847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.019067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.019654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.020688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] PATH_INFO: `/v3/projects/858db19d2239483ead75852c35fb7b99` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.022123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858db19d2239483ead75852c35fb7b99)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.024407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.078870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858db19d2239483ead75852c35fb7b99', 'request_id': 'req-5e0e323a-ea93-4f32-8352-206d48488b24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.085941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858db19d2239483ead75852c35fb7b99', 'request_id': 'req-5e0e323a-ea93-4f32-8352-206d48488b24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.093190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858db19d2239483ead75852c35fb7b99', 'request_id': 'req-5e0e323a-ea93-4f32-8352-206d48488b24'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.115189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] The token cache is being invalidate because project 858db19d2239483ead75852c35fb7b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:58.115915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.116760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5e0e323a-ea93-4f32-8352-206d48488b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.118571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1009/2052] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:57 2022] DELETE /identity/v3/projects/858db19d2239483ead75852c35fb7b99 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:58.126254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.126776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.127349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.154305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:58.156567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.232999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1044/2053] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:58.241596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.242139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.242632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.262815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:58.264050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.276849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1010/2054] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:58.281748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.291999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdab4e1-96b3-482c-bccb-00bd7fb30d35 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.294194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.296015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.298657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.299652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.300090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.300703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.301503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:58.301951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.304436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.308558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac6615-e4d3-4548-a0e1-0755d401e547 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.313861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.314635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.314982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.315429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] PATH_INFO: `/v3/projects/0d86349c5d664c29b309fcd551882992` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.316581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d86349c5d664c29b309fcd551882992)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.317616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1045/2055] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:38:58.318804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.321944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.336504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c35bf-0dd8-4cf0-87ef-add2f49bd9dd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.341244 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.341836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.342112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.342379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.343022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.345056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.357063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.373700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d86349c5d664c29b309fcd551882992', 'request_id': 'req-44308eef-77b8-4dfb-b2ee-58a45153894b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.375276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1046/2056] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:58.378870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.380258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d86349c5d664c29b309fcd551882992', 'request_id': 'req-44308eef-77b8-4dfb-b2ee-58a45153894b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.386596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d86349c5d664c29b309fcd551882992', 'request_id': 'req-44308eef-77b8-4dfb-b2ee-58a45153894b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.400385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] The token cache is being invalidate because project 0d86349c5d664c29b309fcd551882992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:58.400754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.401481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.403007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1011/2057] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:58 2022] DELETE /identity/v3/projects/0d86349c5d664c29b309fcd551882992 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:58.407595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.408911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.449627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65943523-0c29-4431-8800-42159f2ecb5a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.454809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.455444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.456009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.456257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.456871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.458769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.479078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308eef-77b8-4dfb-b2ee-58a45153894b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.484640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1047/2058] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:58.484875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.484875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.485190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.485190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] PATH_INFO: `/v3/users/a7d9680ceb6b40c69d6104e0b1197024` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.485833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.486377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d9680ceb6b40c69d6104e0b1197024)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.487543 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.488506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.500661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3dd9b-521f-4d2e-8652-5f17446db93f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.505723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.506325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.506595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.506860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.507526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.509108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.524544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1048/2059] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:58.525554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.536114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc2176-1334-4db1-ad02-304bf0c2a0e1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.539992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d9680ceb6b40c69d6104e0b1197024'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.540847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.541430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.541711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.541985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.542615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.544345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.548276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d9680ceb6b40c69d6104e0b1197024'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.555100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1049/2060] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:58.555350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d9680ceb6b40c69d6104e0b1197024'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.559160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.569550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d9680ceb6b40c69d6104e0b1197024'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.570319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d5105061-ef80-4954-9fd6-1a6cbc526f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d9680ceb6b40c69d6104e0b1197024'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:58.571346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53790d-1a64-44d5-ab57-44f94800a6f3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.579324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1012/2061] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:38:58 2022] DELETE /identity/v3/users/a7d9680ceb6b40c69d6104e0b1197024 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:58.581424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.581424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.581424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.581716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] PATH_INFO: `/v3/projects/706ab528cf204780a79eff12708e428c/users/6b87b317e44a4988b974375c9779852a/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.586998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.601968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706ab528cf204780a79eff12708e428c, user_id=6b87b317e44a4988b974375c9779852a, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.604666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.618379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1050/2062] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:58 2022] PUT /identity/v3/projects/706ab528cf204780a79eff12708e428c/users/6b87b317e44a4988b974375c9779852a/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:58.631390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.631736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.632078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.663414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] MFA Rules not processed for user `6b87b317e44a4988b974375c9779852a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:58.664607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.704157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:58.764204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1013/2063] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:58.775978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.777729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.835863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa73ba4-89a2-4056-85a8-7dc1f495f815 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.839506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.840110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.840385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.840650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.849519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.850948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ae86e-b820-4815-bfc4-1d006ac85eec service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:58.860536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1051/2064] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:38:58.884465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:58.885977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:58.955992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869391e-89e5-4f27-9e66-a0c9943d25b9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:58.961334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:58.962058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:58.962256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:58.962525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] PATH_INFO: `/v3/projects/d1f5814c083946f98678d7cca12ec3b2` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:58.963690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f5814c083946f98678d7cca12ec3b2)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:58.965588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.026584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f5814c083946f98678d7cca12ec3b2', 'request_id': 'req-babef0a7-ff71-45ba-9807-74af1575894c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:59.033178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f5814c083946f98678d7cca12ec3b2', 'request_id': 'req-babef0a7-ff71-45ba-9807-74af1575894c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:59.040066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f5814c083946f98678d7cca12ec3b2', 'request_id': 'req-babef0a7-ff71-45ba-9807-74af1575894c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:59.054143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] The token cache is being invalidate because project d1f5814c083946f98678d7cca12ec3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:38:59.054433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:59.055067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-babef0a7-ff71-45ba-9807-74af1575894c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:38:59.060121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1014/2065] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:38:58 2022] DELETE /identity/v3/projects/d1f5814c083946f98678d7cca12ec3b2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:38:59.061589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.061878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.062197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.082951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:59.084333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:59.154136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1052/2066] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:38:59.157882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.158304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.158641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.180398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:59.181610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:59.191912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1015/2067] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:59.199726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.210240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d38ec7-ac18-4225-8a63-c31d28ab6250 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.214819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.215451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.215728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.216028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.216665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:38:59.216970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.218741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.230513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1053/2068] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:38:59.234712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.244557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cacdd-0bab-4a47-b290-ef7874dbce25 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.249408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.250543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.250820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.251090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.251742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.253660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.280106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1016/2069] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:59.284300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.294309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82150d8b-dd6b-4ba0-82eb-2d16fc883a51 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.353835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.354779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.355060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.355361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.355987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.357890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.380849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1054/2070] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:59.384913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.395608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb45c-25cd-4c05-9e4b-ccc40dc48836 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.400090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.400676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.401033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.401205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.401834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.403442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.413162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1017/2071] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:59.416955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.423459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.427217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0393584-cbd7-4f48-9977-205e6c04c482 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.432949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.433542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.433823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.434097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.434730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.436392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6697e5-832f-4158-8243-1f877de410f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.447483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1055/2072] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:59.451660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.461770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4ccc-7507-4522-aa17-d11eca0f7333 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.466286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.466923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.467201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.467500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] PATH_INFO: `/v3/projects/1f1b3b504f094dfcb996a24ca5b31e2f/users/ffa0c1b531334e019c05e6eae24187f7/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.482729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1b3b504f094dfcb996a24ca5b31e2f, user_id=ffa0c1b531334e019c05e6eae24187f7, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.485984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.488949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:38:59.501171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1018/2073] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:59 2022] PUT /identity/v3/projects/1f1b3b504f094dfcb996a24ca5b31e2f/users/ffa0c1b531334e019c05e6eae24187f7/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:59.512604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.512890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.513165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.541554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] MFA Rules not processed for user `ffa0c1b531334e019c05e6eae24187f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:38:59.542701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:38:59.610169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1056/2074] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:38:59.614609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.674826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e876b3d-8d7e-4843-9623-1c696844660b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.679455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.680049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.680324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.680596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.681221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.683089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.710031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1019/2075] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:38:59.714084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.725458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83dec2-6871-44a6-85b7-5d00445d215b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.782985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.783638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.783900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.784167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.784790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.786715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.807461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1057/2076] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:38:59 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:38:59.811094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.821226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d734-b928-47fd-be1f-433571c3c746 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.825773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.826355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.826629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.826895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.828061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.829665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.840320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1020/2077] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:38:59.844889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.855285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec6ae-eece-4e4b-83c2-851aa97fb2e7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.859821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.860457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.860733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.860999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] PATH_INFO: `/v3/projects/74ba3a3af59a4202b2010620bb4fffa3/users/f9ee02226e3f497a843e103b95267d7c/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.875186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ba3a3af59a4202b2010620bb4fffa3, user_id=f9ee02226e3f497a843e103b95267d7c, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.877951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.891297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1058/2078] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:59 2022] PUT /identity/v3/projects/74ba3a3af59a4202b2010620bb4fffa3/users/f9ee02226e3f497a843e103b95267d7c/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:38:59.895324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.904987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c98e02-ac19-4dac-bd7f-68b3a8020bc5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.960580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.961167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.961444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.961709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.962361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.963956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ed56b-7cf0-42af-b3ad-009c89faea07 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:38:59.973791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1021/2079] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:38:59.978140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:38:59.988226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b155-6f25-477c-acb5-3b358ce57b13 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:38:59.992749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:38:59.993374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:38:59.993646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:38:59.993912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] PATH_INFO: `/v3/projects/74ba3a3af59a4202b2010620bb4fffa3/users/f9ee02226e3f497a843e103b95267d7c/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:38:59.995798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ba3a3af59a4202b2010620bb4fffa3, user_id=f9ee02226e3f497a843e103b95267d7c, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:38:59.998391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.008703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1059/2080] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:38:59 2022] PUT /identity/v3/projects/74ba3a3af59a4202b2010620bb4fffa3/users/f9ee02226e3f497a843e103b95267d7c/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:00.019099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.019412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.019687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.047593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] MFA Rules not processed for user `f9ee02226e3f497a843e103b95267d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:00.048783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:00.098388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.116247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1022/2081] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:00.129075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.130796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:00.169930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:00.189332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602fac-d4d4-4866-b53f-fab908e895a4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.193145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.193747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.194020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.194285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.204427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.206113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.216162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1060/2082] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:00.533105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.542150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f742bb-3aef-42ac-b2d7-ad3a8e5b8ad8 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.547301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ee02226e3f497a843e103b95267d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ba3a3af59a4202b2010620bb4fffa3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.547900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.548187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.548461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.549097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.549400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.550981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.562676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1023/2083] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.566737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.575815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d30f-e73e-4470-a1c1-b95e725d6bb6 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.580368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ee02226e3f497a843e103b95267d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ba3a3af59a4202b2010620bb4fffa3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.581212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.581489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.581760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.582381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.584316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.612300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1061/2084] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:00 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:00.616292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.626762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53620f9b-c847-4c5d-93bc-0b6ec98ba510 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.680724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ee02226e3f497a843e103b95267d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ba3a3af59a4202b2010620bb4fffa3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.681494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.681776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.682051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.682694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:00.682998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.684670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.697065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1024/2085] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:00.734842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:00.745036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138249d-75e1-40fb-9a95-209c55018aac tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:00.749572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ee02226e3f497a843e103b95267d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74ba3a3af59a4202b2010620bb4fffa3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:00.750179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:00.750455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:00.750722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] PATH_INFO: `/v3/projects/24f9825469594488b92053efb39178bc` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:00.751831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorizing `identity:delete_project(project_id=24f9825469594488b92053efb39178bc)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:00.753740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:00.798755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f9825469594488b92053efb39178bc', 'request_id': 'req-0b26dcfd-fe51-4ad0-8462-fa882ff94875'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:00.804179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f9825469594488b92053efb39178bc', 'request_id': 'req-0b26dcfd-fe51-4ad0-8462-fa882ff94875'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:00.810845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f9825469594488b92053efb39178bc', 'request_id': 'req-0b26dcfd-fe51-4ad0-8462-fa882ff94875'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:00.825104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] The token cache is being invalidate because project 24f9825469594488b92053efb39178bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:00.825390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:00.826035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0b26dcfd-fe51-4ad0-8462-fa882ff94875 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:00.828301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1062/2086] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:00 2022] DELETE /identity/v3/projects/24f9825469594488b92053efb39178bc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:01.016775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.018603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:01.082129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ebfa-7fc1-4136-86e8-724cc59955d4 tempest-VolumeQuotaClassesTest-871737028 tempest-VolumeQuotaClassesTest-871737028-project-admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.135305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.135917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.136191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.136454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] PATH_INFO: `/v3/users/ffa0c1b531334e019c05e6eae24187f7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.137567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa0c1b531334e019c05e6eae24187f7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.139483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.160282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.188054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa0c1b531334e019c05e6eae24187f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.195028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa0c1b531334e019c05e6eae24187f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.202232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa0c1b531334e019c05e6eae24187f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.214228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa0c1b531334e019c05e6eae24187f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.214890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa0c1b531334e019c05e6eae24187f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.220712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1025/2087] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:01 2022] DELETE /identity/v3/users/ffa0c1b531334e019c05e6eae24187f7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:01.225223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.225678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.225767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.244555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:01.245741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:01.309925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1063/2088] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:01.319320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.320735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:01.382310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2c5a-3c4e-4613-9a8a-7b9f4758e8cf admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.386176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.386789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.389282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.389572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.401343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.403096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.414730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1026/2089] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:01.725759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.727199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:01.745277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c91d2e-1491-4057-9ba0-af10909df569 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.751213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.752285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.752713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.753045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] PATH_INFO: `/v3/projects/1f1b3b504f094dfcb996a24ca5b31e2f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.754154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1b3b504f094dfcb996a24ca5b31e2f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.756094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.795041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.806887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1b3b504f094dfcb996a24ca5b31e2f', 'request_id': 'req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.813049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1b3b504f094dfcb996a24ca5b31e2f', 'request_id': 'req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.819130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1b3b504f094dfcb996a24ca5b31e2f', 'request_id': 'req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.831896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] The token cache is being invalidate because project 1f1b3b504f094dfcb996a24ca5b31e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:01.832180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.832797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.834272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1064/2090] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:01 2022] DELETE /identity/v3/projects/1f1b3b504f094dfcb996a24ca5b31e2f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:01.838223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:01.847663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b7a41-ae6b-4b32-aadc-a404628f0dd3 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:01.905555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:01.906786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:01.907064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:01.907364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] PATH_INFO: `/v3/users/f9ee02226e3f497a843e103b95267d7c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:01.908488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ee02226e3f497a843e103b95267d7c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:01.910394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:01.954426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:01.957543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ee02226e3f497a843e103b95267d7c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.966345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ee02226e3f497a843e103b95267d7c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.973661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ee02226e3f497a843e103b95267d7c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.986032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ee02226e3f497a843e103b95267d7c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.986665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-60ed9cd4-05a3-4f9d-bf7d-d22d4ad03b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ee02226e3f497a843e103b95267d7c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:01.992409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1027/2091] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:01 2022] DELETE /identity/v3/users/f9ee02226e3f497a843e103b95267d7c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:02.273507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.275549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:02.292093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd436d1-1732-4b84-bc4e-f3dbfacfb81f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.379906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.380532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.380810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.381084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] PATH_INFO: `/v3/projects/74ba3a3af59a4202b2010620bb4fffa3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.382233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ba3a3af59a4202b2010620bb4fffa3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.384206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.437968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ba3a3af59a4202b2010620bb4fffa3', 'request_id': 'req-f85180fb-af5b-4f6c-951f-510f13e3897e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:02.443677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ba3a3af59a4202b2010620bb4fffa3', 'request_id': 'req-f85180fb-af5b-4f6c-951f-510f13e3897e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:02.450333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ba3a3af59a4202b2010620bb4fffa3', 'request_id': 'req-f85180fb-af5b-4f6c-951f-510f13e3897e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:02.464352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] The token cache is being invalidate because project 74ba3a3af59a4202b2010620bb4fffa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:02.464697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:02.465253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f85180fb-af5b-4f6c-951f-510f13e3897e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:02.470726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1065/2092] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:02 2022] DELETE /identity/v3/projects/74ba3a3af59a4202b2010620bb4fffa3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:02.472665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.473138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.473227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.494973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:02.496239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:02.560926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1028/2093] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:02.568712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.569058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.569262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.590396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:02.591724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:02.604006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1066/2094] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:02.604873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.615186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c6662-63c1-4a23-951d-a43cb1effca3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.619814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.620401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.620678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.620943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.621575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:02.621872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.623462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.635216 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1029/2095] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:02.639685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.649762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d8e97-edde-4bf4-ab53-5f76ca517033 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.654786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.655416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.656294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.656579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.657203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.659159 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.688092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1067/2096] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:02 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:02.692524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.702488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d1e12-492f-4f90-9bd7-98ff16f47b9e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.760839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.761436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.761731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.761997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.762791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.764742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.786964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1030/2097] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:02 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:02.790956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.812533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6d8a7-5952-4318-9425-793de837f026 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.817284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.817906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.818181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.818455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.819127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.820858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.837001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1068/2098] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:02.840680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.851708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cd712-7d20-4ede-8a3f-595267adc8f7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.857070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.857749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.858102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.858450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.859196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.861010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e9a29-885d-4c53-ac7c-d56827a6df1d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.872185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1031/2099] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:02.876383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:02.890904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464107-83eb-4ec5-a075-dd4bb8121b75 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:02.896580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:02.897441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.897726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.897990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] PATH_INFO: `/v3/projects/2b663140b973498f833b233478ac439f/users/63a59063427149aab7dbec03a6b13390/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.910339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:02.915585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b663140b973498f833b233478ac439f, user_id=63a59063427149aab7dbec03a6b13390, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:02.919341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:02.938300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1069/2100] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:02 2022] PUT /identity/v3/projects/2b663140b973498f833b233478ac439f/users/63a59063427149aab7dbec03a6b13390/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:02.949929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:02.950191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:02.950389 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:02.983198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] MFA Rules not processed for user `63a59063427149aab7dbec03a6b13390`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:02.985235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:03.013327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:03.072932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1032/2101] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:03.086431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:03.088528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:03.146715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcea0b-5303-469e-b8e6-9e6226f7fa64 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:03.150384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:03.150989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:03.151284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:03.151562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:03.161918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:03.163483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:03.173687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1070/2102] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:12.580918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.582945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:12.588609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.669038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49661fa3-be86-4725-b9b0-59f3c34bbd5a service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.671547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e226fa-20b5-4987-804b-3c5ba2d0b26e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.674290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.675568 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.675839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.676114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] PATH_INFO: `/v3/users/63a59063427149aab7dbec03a6b13390` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.676530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.677286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.677455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a59063427149aab7dbec03a6b13390)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.677818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.678159 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] PATH_INFO: `/v3/users/6b87b317e44a4988b974375c9779852a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.679392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b87b317e44a4988b974375c9779852a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.679659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.681309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.746090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a59063427149aab7dbec03a6b13390'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.750195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b87b317e44a4988b974375c9779852a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.755929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a59063427149aab7dbec03a6b13390'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.760915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b87b317e44a4988b974375c9779852a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.764844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a59063427149aab7dbec03a6b13390'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.765527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a59063427149aab7dbec03a6b13390'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.769914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b87b317e44a4988b974375c9779852a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.779684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf763f2d-aba8-4ea5-8336-680c4ac4807f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a59063427149aab7dbec03a6b13390'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.783929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b87b317e44a4988b974375c9779852a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.784685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-12872871-5201-4487-9434-60c8a820f9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b87b317e44a4988b974375c9779852a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:12.787718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1071/2103] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:12 2022] DELETE /identity/v3/users/63a59063427149aab7dbec03a6b13390 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:12.792018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.792304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.792597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.793017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1033/2104] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:12 2022] DELETE /identity/v3/users/6b87b317e44a4988b974375c9779852a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:12.799414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.799414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.799414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.812288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:12.813505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:12.819048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:12.819524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.819999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:12.855166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:12.886953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1072/2105] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:12.897002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.898326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1034/2106] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:12.901509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:12.908064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:12.909541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:12.960730 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1fbb-7827-44f1-b11b-b20ef964c334 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.964793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.967005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.967316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.967599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:12.976871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057526cb-d99f-462a-bbba-cbbbb6f7f563 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:12.981175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:12.982161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:12.985238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:12.985872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:12.986190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:12.986506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.006184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.007398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3eb72-542f-4c73-84d6-6944a60c62e8 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.016195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1073/2107] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:13.018856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1035/2108] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:39:13.119028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.120519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.134053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a801b-d3dd-4ba6-a103-73fd5231d140 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.138734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.139547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.140319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.140649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] PATH_INFO: `/v3/users/d79b7dca6b234185b7a3e1fbdfee118e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.141904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79b7dca6b234185b7a3e1fbdfee118e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.144028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.195923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79b7dca6b234185b7a3e1fbdfee118e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.206461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79b7dca6b234185b7a3e1fbdfee118e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.224088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79b7dca6b234185b7a3e1fbdfee118e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.224806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79b7dca6b234185b7a3e1fbdfee118e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.245752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79b7dca6b234185b7a3e1fbdfee118e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.253020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1074/2109] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:13 2022] DELETE /identity/v3/users/d79b7dca6b234185b7a3e1fbdfee118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:13.257352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.257623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.257892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.282569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:13.283814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.354602 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1036/2110] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:13.370070 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.371808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.425126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:13.464461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.466256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.483989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df9090-c37f-4593-bcd6-78d5ec5806b3 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.489364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.492568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.492568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.492568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] PATH_INFO: `/v3/projects/2b663140b973498f833b233478ac439f` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.510049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b663140b973498f833b233478ac439f)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.512853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.514671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794f33f-cc91-4897-8afe-a3efbd138103 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.521432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.522507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.522965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.523271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.535911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.537365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.552982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1075/2111] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:39:13.554165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.556086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.571741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b663140b973498f833b233478ac439f', 'request_id': 'req-04156679-4ff3-45f8-b1f0-4fb92801d71f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.575497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c26c06-5f05-47f4-b24f-db5f538423ed service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.578184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b663140b973498f833b233478ac439f', 'request_id': 'req-04156679-4ff3-45f8-b1f0-4fb92801d71f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.585107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b663140b973498f833b233478ac439f', 'request_id': 'req-04156679-4ff3-45f8-b1f0-4fb92801d71f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.599671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] The token cache is being invalidate because project 2b663140b973498f833b233478ac439f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:13.599963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.600618 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-04156679-4ff3-45f8-b1f0-4fb92801d71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.602379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1037/2112] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:13 2022] DELETE /identity/v3/projects/2b663140b973498f833b233478ac439f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:13.608004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb1b5-e909-4cbf-9809-7b0a1cca557e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.608288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb1b5-e909-4cbf-9809-7b0a1cca557e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.609192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeb1b5-e909-4cbf-9809-7b0a1cca557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.617701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:13.636445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a5aeb1b5-e909-4cbf-9809-7b0a1cca557e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:13.638009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a5aeb1b5-e909-4cbf-9809-7b0a1cca557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.670562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.671409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.671695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.672094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] PATH_INFO: `/v3/projects/706ab528cf204780a79eff12708e428c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.673372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706ab528cf204780a79eff12708e428c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.675403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.721546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1038/2113] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:13.727154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.727590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.727863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.734466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706ab528cf204780a79eff12708e428c', 'request_id': 'req-167293f1-8ce6-47f8-baed-961f38913495'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.740157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706ab528cf204780a79eff12708e428c', 'request_id': 'req-167293f1-8ce6-47f8-baed-961f38913495'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.747707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706ab528cf204780a79eff12708e428c', 'request_id': 'req-167293f1-8ce6-47f8-baed-961f38913495'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.751114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:13.752568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.768585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] The token cache is being invalidate because project 706ab528cf204780a79eff12708e428c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:13.768934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.769648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:13.771611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1076/2114] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:13 2022] DELETE /identity/v3/projects/706ab528cf204780a79eff12708e428c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:13.853811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1039/2115] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:13.863382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.878187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167293f1-8ce6-47f8-baed-961f38913495 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.884533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.885469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.885767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.886128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.887295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:13.887609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.890162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.899363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.902738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:13.912947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1077/2116] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:13.916974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:13.929165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e5faf-bb1f-4286-8eec-bf81f0cb2c27 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.937189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.937953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.938333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.938849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] PATH_INFO: `/v3/projects/983f4b6f7711433fb16502261b4b27a4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.940287 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828514-ae54-485c-990f-f325b3d117b2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:13.941493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983f4b6f7711433fb16502261b4b27a4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.944201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.951203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:13.951862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:13.953251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:13.953518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:13.954150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:13.956849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:13.999654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1078/2117] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:13 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:14.003638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.011620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983f4b6f7711433fb16502261b4b27a4', 'request_id': 'req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:14.017854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983f4b6f7711433fb16502261b4b27a4', 'request_id': 'req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:14.025178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983f4b6f7711433fb16502261b4b27a4', 'request_id': 'req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:14.037160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.045846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] The token cache is being invalidate because project 983f4b6f7711433fb16502261b4b27a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:14.046169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:14.047146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-7661d870-8dbd-48a0-8ee2-ed025b0a0b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:14.048689 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1040/2118] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:13 2022] DELETE /identity/v3/projects/983f4b6f7711433fb16502261b4b27a4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:14.053375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168b23-4aaf-4daf-af3f-392314386a7a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.053653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168b23-4aaf-4daf-af3f-392314386a7a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.053919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d168b23-4aaf-4daf-af3f-392314386a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.079096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9d168b23-4aaf-4daf-af3f-392314386a7a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.080502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d168b23-4aaf-4daf-af3f-392314386a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.087502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb19ba-3c2b-408b-b7c6-ee753c9b15a2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.095232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.095879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.096181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1041/2119] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:14.099578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.100068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.100791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.103258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.103604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.103886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.104155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.124572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.125777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.129855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1079/2120] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:14.133596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.134176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1042/2121] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:14.135400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.137993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.147693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5c4ee-e12d-4b73-b8bf-20335abfcf86 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.147827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e03abe-0b72-4a65-be78-4dbcf28a4b98 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.152379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.152509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.152966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.153075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.153250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.153375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.153524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.153631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.154149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.154252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:14.154458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.156395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.156694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.165158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.166300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1080/2122] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:14.172632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1043/2123] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:39:14.172771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.173629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.180690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0913-091b-45b9-881b-ade09c1cea3e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.184034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c563f93-40df-47f9-a2e3-d6668cb64e68 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.189474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.190093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.190376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.190651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.191310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.191780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.192418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.192695 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.192965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.193377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.193628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.195216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.206888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1081/2124] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:14.210961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.221098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f1c59-3eb1-4508-b3ed-83313fa3eba0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.222979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1044/2125] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:14.226885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.278463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.279144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.279463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.279751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] PATH_INFO: `/v3/projects/f2b62ba61aeb459eade55243a8187505/users/0b1c65231a70438fb722d0e544735526/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.287806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff18ca1-954a-4ffe-8c58-0d05b81229d6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.292725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.293326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.293601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.293883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.294479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.294842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b62ba61aeb459eade55243a8187505, user_id=0b1c65231a70438fb722d0e544735526, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.297525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.298409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ca3c3-5cd1-4f9d-b3d0-215469abc40b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.314335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1082/2126] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:14 2022] PUT /identity/v3/projects/f2b62ba61aeb459eade55243a8187505/users/0b1c65231a70438fb722d0e544735526/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:14.320096 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.320671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.320947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.328150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1045/2127] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:14.329093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.338946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8fa4-c350-4814-b915-e0988a6944d0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.339545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.340778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.397046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.397649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.398234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.398349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1083/2128] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:14.398441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.399053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.400698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.408268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.409665 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.411676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1046/2129] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:14.415508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.425016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dbd6d-51a8-423b-afa6-c63786850e17 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.429920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.432261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.433017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.433477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.433711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.435139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.438450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.450907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1047/2130] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:14.456053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.466139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0242639-b2e0-45f0-902b-f1b2b768a536 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.470869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.471547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.472027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.472304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] PATH_INFO: `/v3/projects/eb9ebf85734641cd90f2c5fe09326b7f/users/43e51423994848c0a4ac249964289705/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.482211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7165775-a775-4e58-806f-46f103d793e4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.490073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9ebf85734641cd90f2c5fe09326b7f, user_id=43e51423994848c0a4ac249964289705, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.491647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.492270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.492549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.492764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413fccdb-4e36-4b81-a642-a5c2bfb53d16 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.492885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.508072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.509601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.512476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1048/2131] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:14 2022] PUT /identity/v3/projects/eb9ebf85734641cd90f2c5fe09326b7f/users/43e51423994848c0a4ac249964289705/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:14.524400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1084/2132] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:14.524782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.525070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.525450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.554613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] MFA Rules not processed for user `43e51423994848c0a4ac249964289705`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:14.555913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:14.586439 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:14.647187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1049/2133] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:14.651511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.661381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fcb454-002f-4a11-b358-08f22b0c374a service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.748936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.750583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.750871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.751146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.751860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.754251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.785743 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1085/2134] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:14.786913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.798923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6272c9-f491-4166-b2e1-53d61ce96b4a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.877037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.877776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.878116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.878457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.879378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.881772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.909709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1050/2135] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:14 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:14.911324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.922640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e543428-021f-4391-aafc-b0bb749ebeb4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.927646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.928285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.928750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.929021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.929660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.931272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.943840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1086/2136] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:14.947944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:14.959311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b977a-db38-4a5a-b487-4ccd7663fe60 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:14.963955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:14.964552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:14.964947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:14.965218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:14.965920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:14.971312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf2b58-8e93-46d2-b5af-9daa42fe2e52 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:14.987085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1051/2137] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:14.991129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.003066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29841ef-9d8c-40da-ad49-ec7dcdab4725 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.006904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.007709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.008064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.008413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] PATH_INFO: `/v3/projects/a96902fa033d4f47a7e5220a6991d41c/users/5d8fd7c1bd8947f9b8333bb83c202330/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.025693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96902fa033d4f47a7e5220a6991d41c, user_id=5d8fd7c1bd8947f9b8333bb83c202330, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.028420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.045390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1087/2138] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:14 2022] PUT /identity/v3/projects/a96902fa033d4f47a7e5220a6991d41c/users/5d8fd7c1bd8947f9b8333bb83c202330/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:15.056133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c01d-79ae-4b7a-813f-8fc8f30f75da None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.056420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c01d-79ae-4b7a-813f-8fc8f30f75da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.056694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c01d-79ae-4b7a-813f-8fc8f30f75da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.085481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0f07c01d-79ae-4b7a-813f-8fc8f30f75da None None] MFA Rules not processed for user `5d8fd7c1bd8947f9b8333bb83c202330`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:15.086780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0f07c01d-79ae-4b7a-813f-8fc8f30f75da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.166857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1052/2139] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:15.172698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.258653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56350c-301a-47a4-b693-b79fa549cd13 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.264191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.265485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.265825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.266315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.266424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.266728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.266999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.267343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.269530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.290038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.303205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] MFA Rules not processed for user `0b1c65231a70438fb722d0e544735526`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:15.305974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.311406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1088/2140] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:15.315717 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.328858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.399991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1053/2141] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:15.404664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6a182-ba82-4ddb-badd-3d96ce4918e2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.410145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.410763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.410961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.411624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.412098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.412741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.412907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.415858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.444809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1089/2142] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:15.445698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.456901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757e22a-66c6-458a-82b9-625f7b9e888b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.461689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.462360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.462644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.462935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.463601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.465187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.476313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1090/2143] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:15.480369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.481026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd0d7f-a785-4d24-9e9e-dedeb1d2458c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.491889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c22c9-bfc3-4bee-a011-af655900e67e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.496958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.497744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.498055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.498764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] PATH_INFO: `/v3/projects/90d602778f6c4ccb8775569488c403db/users/4064565b1bd14b46b90b613cd51d0a74/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.518309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d602778f6c4ccb8775569488c403db, user_id=4064565b1bd14b46b90b613cd51d0a74, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.520980 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.534615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1091/2144] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:15 2022] PUT /identity/v3/projects/90d602778f6c4ccb8775569488c403db/users/4064565b1bd14b46b90b613cd51d0a74/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:15.536126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.536739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.537020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.537522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.538322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.605810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.607442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.612078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f0ff-4b29-4e5f-a02a-34349f69b621 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.616829 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.617443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.617723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.617971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1054/2145] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:39:15.618077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.618622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.620253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48addc4e-9481-4fbb-a931-ee541a2c8a56 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.630978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1092/2146] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:15.635356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.647476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593611d-6511-40fb-884c-27fe3348b53a service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.652736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.653248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.653535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.653813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] PATH_INFO: `/v3/projects/90d602778f6c4ccb8775569488c403db/users/4064565b1bd14b46b90b613cd51d0a74/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.655970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d602778f6c4ccb8775569488c403db, user_id=4064565b1bd14b46b90b613cd51d0a74, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:15.659405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:15.670588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1055/2147] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:15 2022] PUT /identity/v3/projects/90d602778f6c4ccb8775569488c403db/users/4064565b1bd14b46b90b613cd51d0a74/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:15.681360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafe3a-d274-4f50-9651-8c75fcefca71 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.682242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafe3a-d274-4f50-9651-8c75fcefca71 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.682242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafe3a-d274-4f50-9651-8c75fcefca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:15.716855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5dcafe3a-d274-4f50-9651-8c75fcefca71 None None] MFA Rules not processed for user `4064565b1bd14b46b90b613cd51d0a74`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:15.719093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5dcafe3a-d274-4f50-9651-8c75fcefca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.764267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.816005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1093/2148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:15.827896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:15.829732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:15.851784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:15.931567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444c56-d8b0-4ed2-be36-63adb7221dc6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:15.944912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:15.945555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:15.945929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:15.946208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:16.047600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:16.049076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:16.059134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1056/2149] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:17.062014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:17.062521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:17.062521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:17.081833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] MFA Rules not processed for user `0b1c65231a70438fb722d0e544735526`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:17.083017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:17.140879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1094/2150] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:18.651307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:18.659759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f204-0611-4dfb-a44e-91c7d10f2482 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:18.663286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:18.663879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:18.664183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:18.664452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:18.723197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:18.724702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:18.735308 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1057/2151] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:19.370062 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:19.380962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e86fba-53da-4b34-b0b3-5be1822bd790 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:19.384948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:19.385404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:19.385750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:19.386088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:19.395942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:19.397560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8d2a1-4d35-40a1-b9a5-f488d884d519 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:19.410192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1095/2152] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:23.389081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.459886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e710a-27b7-43ab-a72a-c4e944484406 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.464441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.465059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.465332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.465614 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] PATH_INFO: `/v3/users/43e51423994848c0a4ac249964289705` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.466724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e51423994848c0a4ac249964289705)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.468678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.474014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:23.516387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e51423994848c0a4ac249964289705'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:23.528573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e51423994848c0a4ac249964289705'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:23.538529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e51423994848c0a4ac249964289705'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:23.553950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e51423994848c0a4ac249964289705'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:23.554690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e51423994848c0a4ac249964289705'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:23.560945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1058/2153] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:23 2022] DELETE /identity/v3/users/43e51423994848c0a4ac249964289705 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:23.565859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.566365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.566455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.586348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:23.587523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:23.677711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1096/2154] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:23.690506 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:23.693745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:23.778014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761b916-02f2-44c3-bdc1-818872aa9c72 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:23.787601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:23.788236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:23.788517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:23.788791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:23.814153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:23.815645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:23.825613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1059/2155] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:24.590769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.592747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:24.620388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051bc20-b2de-48b2-9e7a-ff5b01ba1f94 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.625750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.626469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.626955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.627534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] PATH_INFO: `/v3/projects/eb9ebf85734641cd90f2c5fe09326b7f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.628664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9ebf85734641cd90f2c5fe09326b7f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.630784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.695563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9ebf85734641cd90f2c5fe09326b7f', 'request_id': 'req-84465e98-2980-4127-8ac5-db14b280c716'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.707187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:24.708992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9ebf85734641cd90f2c5fe09326b7f', 'request_id': 'req-84465e98-2980-4127-8ac5-db14b280c716'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.717274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9ebf85734641cd90f2c5fe09326b7f', 'request_id': 'req-84465e98-2980-4127-8ac5-db14b280c716'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.733352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] The token cache is being invalidate because project eb9ebf85734641cd90f2c5fe09326b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:24.733739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.734453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-84465e98-2980-4127-8ac5-db14b280c716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.736158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1097/2156] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:24 2022] DELETE /identity/v3/projects/eb9ebf85734641cd90f2c5fe09326b7f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:24.740363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:24.750835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149349-3bde-48e4-9945-78b6b67691dc service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:24.811002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:24.811629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:24.811903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:24.812168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] PATH_INFO: `/v3/users/5d8fd7c1bd8947f9b8333bb83c202330` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:24.813291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8fd7c1bd8947f9b8333bb83c202330)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:24.815225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:24.864155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:24.880839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8fd7c1bd8947f9b8333bb83c202330'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.888298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8fd7c1bd8947f9b8333bb83c202330'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.898498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8fd7c1bd8947f9b8333bb83c202330'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.916127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8fd7c1bd8947f9b8333bb83c202330'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.916867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-52059541-1f11-4fc8-97be-14ada10b0ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8fd7c1bd8947f9b8333bb83c202330'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:24.923551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1060/2157] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:24 2022] DELETE /identity/v3/users/5d8fd7c1bd8947f9b8333bb83c202330 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:25.169619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.169903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.170209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.172076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1098/2158] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:25.206786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d9b9-b9c3-4b6e-8ca4-05fe7ec72f41 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.207085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d9b9-b9c3-4b6e-8ca4-05fe7ec72f41 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.207380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4d9b9-b9c3-4b6e-8ca4-05fe7ec72f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.252716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-edc4d9b9-b9c3-4b6e-8ca4-05fe7ec72f41 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:25.254143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-edc4d9b9-b9c3-4b6e-8ca4-05fe7ec72f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:25.270174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.272720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:25.364403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1061/2159] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:25.365289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5de93-6acb-45ce-9b00-5606f30379f5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:25.370680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e5ee-0081-46f2-b52f-780b8a7f03b2 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.370918 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:25.371136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e5ee-0081-46f2-b52f-780b8a7f03b2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.371514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2e5ee-0081-46f2-b52f-780b8a7f03b2 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.372102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.372950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.373513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] PATH_INFO: `/v3/users/d39e95dd7b6e4055842699bbc54c39f5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.374570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1062/2160] 10.222.0.17 () {54 vars in 961 bytes} [Sat Aug 6 20:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:39:25.376017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39e95dd7b6e4055842699bbc54c39f5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:25.379028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:25.380243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.380625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.381009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.408897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:25.412652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:25.429648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1063/2161] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Aug 6 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:25.437537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.450116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be542e-33a0-4791-87f6-274b3b105d60 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:25.460992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39e95dd7b6e4055842699bbc54c39f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.464612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:25.465365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.465643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.465913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.475379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39e95dd7b6e4055842699bbc54c39f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.479669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:25.482331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:25.500176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1064/2162] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:25.502614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39e95dd7b6e4055842699bbc54c39f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.509581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39e95dd7b6e4055842699bbc54c39f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.532210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd4faf67-bcee-477c-9109-8a31dbc4db2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39e95dd7b6e4055842699bbc54c39f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.539426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1099/2163] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:25 2022] DELETE /identity/v3/users/d39e95dd7b6e4055842699bbc54c39f5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:25.762813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.774357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f38e-4f12-49ac-b167-50d9ae31b18a service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:25.837269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:25.837899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.838175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.838442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] PATH_INFO: `/v3/projects/a780800618e549c6b01ef67dd64333c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.839845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a780800618e549c6b01ef67dd64333c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:25.841452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:25.875433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:25.903343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a780800618e549c6b01ef67dd64333c4', 'request_id': 'req-cef2e07e-21c1-4301-8a1d-8df63ede150a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.909470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a780800618e549c6b01ef67dd64333c4', 'request_id': 'req-cef2e07e-21c1-4301-8a1d-8df63ede150a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.918371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a780800618e549c6b01ef67dd64333c4', 'request_id': 'req-cef2e07e-21c1-4301-8a1d-8df63ede150a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.936307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] The token cache is being invalidate because project a780800618e549c6b01ef67dd64333c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:25.936607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.937433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:25.939034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1065/2164] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:25 2022] DELETE /identity/v3/projects/a780800618e549c6b01ef67dd64333c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:25.944210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea63-e7fb-4e60-9f7f-4098e4ed49dc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:25.945276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea63-e7fb-4e60-9f7f-4098e4ed49dc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:25.945552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03ea63-e7fb-4e60-9f7f-4098e4ed49dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:25.960607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:25.962268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:25.967846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7d03ea63-e7fb-4e60-9f7f-4098e4ed49dc None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:25.969034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7d03ea63-e7fb-4e60-9f7f-4098e4ed49dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.050289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1100/2165] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:26.057450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e07e-21c1-4301-8a1d-8df63ede150a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.058040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.058330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.058610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.062529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.063230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.063655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.063938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] PATH_INFO: `/v3/projects/a96902fa033d4f47a7e5220a6991d41c` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.065117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96902fa033d4f47a7e5220a6991d41c)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.067384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.067787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.083697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.085437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.094450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1101/2166] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:26.098705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.110382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87dcd6-e887-4ae6-9834-be2ae4feccad None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.116251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.116854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.117131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.117525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.118364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:26.118655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.120348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.132771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96902fa033d4f47a7e5220a6991d41c', 'request_id': 'req-5569e226-5013-4dd9-8b45-2b404330dde7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.133660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1102/2167] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:26.137936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.139100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96902fa033d4f47a7e5220a6991d41c', 'request_id': 'req-5569e226-5013-4dd9-8b45-2b404330dde7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.146730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96902fa033d4f47a7e5220a6991d41c', 'request_id': 'req-5569e226-5013-4dd9-8b45-2b404330dde7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.149910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017d05a-dc5c-46fe-a30a-68858eda03fb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.160375 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] The token cache is being invalidate because project a96902fa033d4f47a7e5220a6991d41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:26.160664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.161281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.162769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1066/2168] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:25 2022] DELETE /identity/v3/projects/a96902fa033d4f47a7e5220a6991d41c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:26.166677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.168017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.209156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.209864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.210142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.210412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.211020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.212945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.217000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.237663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e226-5013-4dd9-8b45-2b404330dde7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.241049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1103/2169] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:26.243229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.243881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.244251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.244530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] PATH_INFO: `/v3/users/4064565b1bd14b46b90b613cd51d0a74` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.245200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.245665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4064565b1bd14b46b90b613cd51d0a74)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.246772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.247621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.307862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4064565b1bd14b46b90b613cd51d0a74'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.325144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4064565b1bd14b46b90b613cd51d0a74'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.334295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4064565b1bd14b46b90b613cd51d0a74'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.339023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d832bf0-517e-4202-92ad-9ca395118867 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.344084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.344698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.344979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.345250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.345949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.347832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.348448 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4064565b1bd14b46b90b613cd51d0a74'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.349206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4064565b1bd14b46b90b613cd51d0a74'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.356008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1067/2170] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:26 2022] DELETE /identity/v3/users/4064565b1bd14b46b90b613cd51d0a74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:26.374251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1104/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:26.378666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.380881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.460049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53b9a1-3023-4386-9392-ead0cc1a273c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.464950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.465666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.466046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.466499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.467870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.470160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.480758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1068/2172] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:26.485441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.495831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e79660-9cb0-4abd-8fbc-fefcbce6d7de admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.500764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.501361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.501637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.501906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.502545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.504167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e83ab-e653-4220-bc88-b23548380977 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.520537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1105/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:26.525016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.536325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e90d-1fbe-4970-ae64-528dd2f76555 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.540934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.541582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.542044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.542325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] PATH_INFO: `/v3/projects/a301a9f453aa435dbd07ff1d074e5a08/users/8dcb94f981244d569f1dd791a4d911ac/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.557115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a301a9f453aa435dbd07ff1d074e5a08, user_id=8dcb94f981244d569f1dd791a4d911ac, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.559879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.575404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1069/2174] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:26 2022] PUT /identity/v3/projects/a301a9f453aa435dbd07ff1d074e5a08/users/8dcb94f981244d569f1dd791a4d911ac/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:39:26.580522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.581190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.581824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.602322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.603698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.646354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.648277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.664731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.697160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1106/2175] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:26.705314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:26.707066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.708608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.738424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880b7c8-3eaf-4c35-bb16-e5130fb73be6 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.743573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.744207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.744486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.744756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] PATH_INFO: `/v3/projects/90d602778f6c4ccb8775569488c403db` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.745872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d602778f6c4ccb8775569488c403db)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.747885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.771048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffb70f-c100-44a8-9f04-9ae4cde73036 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.774783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.775415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.775697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.775965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.785627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:26.787211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e899c1-6671-46c7-a481-c2ce439e73d4 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:26.797736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1107/2176] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:39:26.800060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d602778f6c4ccb8775569488c403db', 'request_id': 'req-4e62e7df-1368-4ed5-91bd-6d347948ab78'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.805919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d602778f6c4ccb8775569488c403db', 'request_id': 'req-4e62e7df-1368-4ed5-91bd-6d347948ab78'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.812863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d602778f6c4ccb8775569488c403db', 'request_id': 'req-4e62e7df-1368-4ed5-91bd-6d347948ab78'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.825954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] The token cache is being invalidate because project 90d602778f6c4ccb8775569488c403db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:26.826247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.827463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4e62e7df-1368-4ed5-91bd-6d347948ab78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:26.828994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1070/2177] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:26 2022] DELETE /identity/v3/projects/90d602778f6c4ccb8775569488c403db => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:26.835022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.835330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.835651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.856079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.857269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.925033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1108/2178] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:26.933445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.933804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.934152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.962226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:26.963834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:26.976111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1071/2179] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:26.978139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:26.991223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc01d9c-377f-42d8-ac54-517e5cdc40f8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:26.996022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:26.997058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:26.997285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:26.998224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:26.998520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:39:26.999519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.001262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.027657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1109/2180] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:39:27.029257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.047085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd9758-c40c-4e88-bc98-f2a891caf5a6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.056738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.057436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.057718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.057989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.058613 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.066352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.120485 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1072/2181] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:39:27 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:39:27.125118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.140526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979cc4d-0e7d-468e-a268-5336d56ad0d9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.232051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.232673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.232947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.233438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.234072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.236157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.265407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1110/2182] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:39:27 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:39:27.269775 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.283276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0810e7c-ac39-4c30-911f-8d911e0a2d21 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.288503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.289211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.289490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.289777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.290404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.292035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.305874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1073/2183] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:39:27.307188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.318179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595699f-1c6e-45d3-9ab1-9f367d6083a8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.323487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.324085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.324366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.324669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.325437 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.327616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d69e4-7da8-4b0b-9f2a-232637ef954c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.329779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:27.343111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1111/2184] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:39:27.344270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.354985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b2228-01b7-43b6-ad7c-6076954b11d2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.360645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.361391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.361764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.362128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] PATH_INFO: `/v3/projects/7206a96954eb49d1a5cddf61eca1197b/users/16237a04fc3e4aa89fdc97a329e6f0c4/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.378897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7206a96954eb49d1a5cddf61eca1197b, user_id=16237a04fc3e4aa89fdc97a329e6f0c4, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.381681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.397946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1074/2185] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:39:27 2022] PUT /identity/v3/projects/7206a96954eb49d1a5cddf61eca1197b/users/16237a04fc3e4aa89fdc97a329e6f0c4/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:27.408537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c480e3-49dc-4437-829a-c966def06107 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.408843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c480e3-49dc-4437-829a-c966def06107 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.409120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c480e3-49dc-4437-829a-c966def06107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.438465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-21c480e3-49dc-4437-829a-c966def06107 None None] MFA Rules not processed for user `16237a04fc3e4aa89fdc97a329e6f0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:27.439741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-21c480e3-49dc-4437-829a-c966def06107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:27.509567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1112/2186] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:27.523617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:27.525798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:27.630259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:27.646841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c5a2b-7d87-4168-8670-67304d78026a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:27.651442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:27.652185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:27.653158 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:27.653595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:27.664331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:27.665996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:27.677379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1075/2187] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:31.706114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16faef7-54b3-422a-8d86-ceb34a792461 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.706635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16faef7-54b3-422a-8d86-ceb34a792461 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.706635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16faef7-54b3-422a-8d86-ceb34a792461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.755118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d16faef7-54b3-422a-8d86-ceb34a792461 None None] MFA Rules not processed for user `8dcb94f981244d569f1dd791a4d911ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:31.759267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d16faef7-54b3-422a-8d86-ceb34a792461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:31.859298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1113/2188] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:31.874257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:31.880963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:31.971202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24ae71-21c0-484e-a93c-832e10340596 service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:31.978027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:31.978650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:31.978929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:31.979198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:31.988532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:31.990129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:32.001099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1076/2189] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:33.420134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fdbe1-4e1e-4864-b7f3-be942c0bcf79 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:33.420692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fdbe1-4e1e-4864-b7f3-be942c0bcf79 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:33.420771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fdbe1-4e1e-4864-b7f3-be942c0bcf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:33.440107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e55fdbe1-4e1e-4864-b7f3-be942c0bcf79 None None] MFA Rules not processed for user `8dcb94f981244d569f1dd791a4d911ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:33.441279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e55fdbe1-4e1e-4864-b7f3-be942c0bcf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:33.448305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1114/2190] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:39:41.995382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=41 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:43.436907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=68 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:48.331687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:48.333245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:48.421143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54c7df-53ab-40b8-bcd0-0a62a3fd3793 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:48.425740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d416-2502-434a-853a-98b38853936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:48.426366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d416-2502-434a-853a-98b38853936f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.426644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d416-2502-434a-853a-98b38853936f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.426920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d416-2502-434a-853a-98b38853936f admin admin] PATH_INFO: `/v3/users/eca79f25734244929cd9fd7d8fd824a0` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.428077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d416-2502-434a-853a-98b38853936f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca79f25734244929cd9fd7d8fd824a0)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:48.429992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d416-2502-434a-853a-98b38853936f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:48.481052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca79f25734244929cd9fd7d8fd824a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:48.489020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca79f25734244929cd9fd7d8fd824a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:48.496545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca79f25734244929cd9fd7d8fd824a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:48.515963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca79f25734244929cd9fd7d8fd824a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:48.517010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca79f25734244929cd9fd7d8fd824a0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:48.523055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1077/2191] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:39:48 2022] DELETE /identity/v3/users/eca79f25734244929cd9fd7d8fd824a0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:48.528803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.530149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.530483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.556044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:39:48.557381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:48.634002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1115/2192] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:39:48.644175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:48.645732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:48.708846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d416-2502-434a-853a-98b38853936f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:48.712560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:48.713202 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:48.713479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:48.713747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:48.724119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:48.725620 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:48.736741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1078/2193] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:39:49.050518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:39:49.054146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:39:49.072407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a13ef-43d4-4c0a-a993-d7039a670f53 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:39:49.077524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:39:49.078173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:39:49.078451 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:39:49.078725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] PATH_INFO: `/v3/projects/531e98e8bef241a4b7fc33f7a249cfaa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:39:49.080423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=531e98e8bef241a4b7fc33f7a249cfaa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:39:49.082642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:39:49.156927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '531e98e8bef241a4b7fc33f7a249cfaa', 'request_id': 'req-efc1af9d-aa0a-4470-b58e-1d523da01c86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:49.163011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '531e98e8bef241a4b7fc33f7a249cfaa', 'request_id': 'req-efc1af9d-aa0a-4470-b58e-1d523da01c86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:49.169535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '531e98e8bef241a4b7fc33f7a249cfaa', 'request_id': 'req-efc1af9d-aa0a-4470-b58e-1d523da01c86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:49.183817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] The token cache is being invalidate because project 531e98e8bef241a4b7fc33f7a249cfaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:39:49.184104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:49.184834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-efc1af9d-aa0a-4470-b58e-1d523da01c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:39:49.186942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1116/2194] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:39:49 2022] DELETE /identity/v3/projects/531e98e8bef241a4b7fc33f7a249cfaa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:39:58.731306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:39:59.180723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:14.608724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:14.610177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:14.622722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3a24f-5d10-42b0-94fc-1462c5000cc0 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:14.678016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:14.678654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:14.678932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:14.679197 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] PATH_INFO: `/v3/users/16237a04fc3e4aa89fdc97a329e6f0c4` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:14.680400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16237a04fc3e4aa89fdc97a329e6f0c4)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:14.682328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:14.728849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16237a04fc3e4aa89fdc97a329e6f0c4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:14.736952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16237a04fc3e4aa89fdc97a329e6f0c4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:14.744505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16237a04fc3e4aa89fdc97a329e6f0c4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:14.756522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16237a04fc3e4aa89fdc97a329e6f0c4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:14.757146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16237a04fc3e4aa89fdc97a329e6f0c4'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:14.762786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1079/2195] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:40:14 2022] DELETE /identity/v3/users/16237a04fc3e4aa89fdc97a329e6f0c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:40:14.767920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:14.768405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:14.768505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:14.788736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:14.790390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:14.850342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1117/2196] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:14.860215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:14.861634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:14.915973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5203df-1a64-4f80-b17e-83289b1eef5d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:14.920076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:14.920661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:14.920936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:14.921203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:14.929883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:14.931304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:14.940962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1080/2197] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:15.289246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:15.290724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:15.303754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5735b0c-1cb5-451c-8c88-405ae15dec8f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:15.308403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:15.309033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:15.309311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:15.309581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] PATH_INFO: `/v3/projects/7206a96954eb49d1a5cddf61eca1197b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:15.310698 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7206a96954eb49d1a5cddf61eca1197b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:15.312627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:15.359198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7206a96954eb49d1a5cddf61eca1197b', 'request_id': 'req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:15.364666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7206a96954eb49d1a5cddf61eca1197b', 'request_id': 'req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:15.371165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7206a96954eb49d1a5cddf61eca1197b', 'request_id': 'req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:15.383079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] The token cache is being invalidate because project 7206a96954eb49d1a5cddf61eca1197b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:40:15.383587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:15.384218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2de3695b-f4f1-4e28-abbb-3f127c5aaba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:40:15.385687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1118/2198] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:40:15 2022] DELETE /identity/v3/projects/7206a96954eb49d1a5cddf61eca1197b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:40:24.936826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:25.380048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:36.066558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:40:36.068052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:36.139140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5dc18-b97e-4b6e-9d8c-7574a43b2f46 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:40:36.197219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:40:36.197807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:36.198088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:36.198353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:36.200088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:36.211554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:40:36.213113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f68cf-2c49-4cd7-af43-eb4c0ab19a47 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:40:36.222507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1081/2199] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:40:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:40:38.757194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc48de-ea3b-4e04-bc9b-ce5e2a99d520 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:40:38.757679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc48de-ea3b-4e04-bc9b-ce5e2a99d520 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:40:38.757885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc48de-ea3b-4e04-bc9b-ce5e2a99d520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:40:38.777222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-33bc48de-ea3b-4e04-bc9b-ce5e2a99d520 None None] MFA Rules not processed for user `919c94bd42144c9b86fd9977e85b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:40:38.779092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-33bc48de-ea3b-4e04-bc9b-ce5e2a99d520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:40:38.831978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1119/2200] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:40:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:40:46.218517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=58 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:40:48.824668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=25 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:00.949431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:00.950541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:00.950642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:00.969285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] MFA Rules not processed for user `0b1c65231a70438fb722d0e544735526`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:00.970468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:01.022948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1082/2201] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:41:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:11.016591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=25 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:41:17.982268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:41:17.982797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:41:17.982797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:41:18.001624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] MFA Rules not processed for user `28a58d55f9cc42c7a041884eee0ea248`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:41:18.002818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:41:18.055842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1120/2202] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:41:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:41:28.049272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=25 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:09.820808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:09.822315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:09.879304 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad1f28-9233-4bac-a840-825589b1b4db None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:09.882857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:09.883488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:09.883768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:09.884036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:09.885700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:09.956797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:09.958575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039d4fc-332c-472d-a6f9-6a2294a65dc7 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:09.969979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1083/2203] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:16.120399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:16.131992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc27f1-6af6-405d-9b8e-71309b43dd75 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:16.135547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:16.136144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:16.136417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:16.136712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:16.138409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:16.151504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:16.153433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b195-c562-40fd-89fc-de7b526a3628 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:16.163951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1121/2204] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:17.985058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:17.985690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:17.985690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:17.987065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1084/2205] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:17.995939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:17.996378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:17.996501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.015593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] MFA Rules not processed for user `83fd7f4118514807bc58c1e28523cdcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:18.016787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.025790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1122/2206] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:18.038900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.041581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.059842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b24f7c-be54-45eb-9ef4-28513df9f33b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.060821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.062285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.064921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.065525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.065802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.066235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.075696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.077281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.087225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1085/2207] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:18.132073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b606293-a172-4251-bfc5-b9aa42a0b3fe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.136689 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.137313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.137612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.137908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] PATH_INFO: `/v3/users/0b1c65231a70438fb722d0e544735526` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.139050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1c65231a70438fb722d0e544735526)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.141022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.185692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1c65231a70438fb722d0e544735526'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.192418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1c65231a70438fb722d0e544735526'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.199586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1c65231a70438fb722d0e544735526'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.200274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1c65231a70438fb722d0e544735526'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.212132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1322447b-ac45-4656-ad3c-9d5ef50921bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1c65231a70438fb722d0e544735526'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.218482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1123/2208] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:42:18 2022] DELETE /identity/v3/users/0b1c65231a70438fb722d0e544735526 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:42:18.391828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.402263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a137f4-9e2d-4b32-8ca1-c9edfe3e69e5 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.459673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.460217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.460490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.460754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] PATH_INFO: `/v3/projects/f2b62ba61aeb459eade55243a8187505` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.461846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b62ba61aeb459eade55243a8187505)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.463774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.499185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:18.514394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b62ba61aeb459eade55243a8187505', 'request_id': 'req-ad179571-6255-47fe-bfd3-5ff40e5620cd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.520488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b62ba61aeb459eade55243a8187505', 'request_id': 'req-ad179571-6255-47fe-bfd3-5ff40e5620cd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.526974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b62ba61aeb459eade55243a8187505', 'request_id': 'req-ad179571-6255-47fe-bfd3-5ff40e5620cd'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.540342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] The token cache is being invalidate because project f2b62ba61aeb459eade55243a8187505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:42:18.540634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.541236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ad179571-6255-47fe-bfd3-5ff40e5620cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:18.542726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1086/2209] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:42:18 2022] DELETE /identity/v3/projects/f2b62ba61aeb459eade55243a8187505 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:42:18.548424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.548710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.548981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.568879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:18.570075 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.620283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:18.631188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1124/2210] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:18.639677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.640072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.640377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.659156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:18.660368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:18.668076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1087/2211] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:18.672591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.682299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669caed1-0492-44eb-ac9f-165fc4e46360 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.686911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.687548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.687822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.688091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.688732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:42:18.689029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.690615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.701828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1125/2212] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:42:18.705929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.715354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86e6a-d200-4adc-b1fc-220405f06d8e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.720413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.720999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.721275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.721543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.722155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.724060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.750922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1088/2213] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:42:18.754915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.764708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60713-f5f1-4733-9b00-76a7441a81f4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.821000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.821723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.821994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.822256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.822861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.824797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.845585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1126/2214] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:42:18.849715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.860469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa982d-77da-414a-a26a-5b76acc80bb1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.865079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.865674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.865954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.866224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.866994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.868592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.878284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1089/2215] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:42:18.882294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.892403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e8fc2-bb1b-443b-93f4-4e7814ab6f88 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.897198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.897780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.898056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.898321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.898954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.900548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd3ff5-1724-4010-b3db-a2dde03db171 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.912564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1127/2216] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:42:18.916625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:18.927269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f89c59-dde7-4791-bb90-2c404cf78680 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:18.931907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:18.932541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.932822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.933095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] PATH_INFO: `/v3/projects/f54fc9931a0c4c8a8dd10f9b32997a4b/users/93dbc427f149499fbb2bb7233c94b46c/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:18.948177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54fc9931a0c4c8a8dd10f9b32997a4b, user_id=93dbc427f149499fbb2bb7233c94b46c, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:18.950817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:18.965096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1090/2217] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:42:18 2022] PUT /identity/v3/projects/f54fc9931a0c4c8a8dd10f9b32997a4b/users/93dbc427f149499fbb2bb7233c94b46c/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:42:18.979031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:18.979221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:18.979519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:19.009566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] MFA Rules not processed for user `93dbc427f149499fbb2bb7233c94b46c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:19.010760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:19.076356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1128/2218] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:19.089169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:19.091542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:19.149668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3d22b-2247-4581-843d-e5b58f93c713 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:19.153359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:19.154562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:19.154836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:19.155100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:19.163532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:19.164939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cacae-30b1-4562-a020-3f3416061f36 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:19.173668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1091/2219] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:28.273899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:28.329103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:28.335799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa7da5-ae0e-4cc5-af2b-e24b7b8ae411 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:28.340449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:28.341654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:28.341928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:28.342196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] PATH_INFO: `/v3/users/93dbc427f149499fbb2bb7233c94b46c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:28.343323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dbc427f149499fbb2bb7233c94b46c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:28.345254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:28.390561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dbc427f149499fbb2bb7233c94b46c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.397290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dbc427f149499fbb2bb7233c94b46c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.405341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dbc427f149499fbb2bb7233c94b46c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.406269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dbc427f149499fbb2bb7233c94b46c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.417948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dbc427f149499fbb2bb7233c94b46c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.423626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1129/2220] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:42:28 2022] DELETE /identity/v3/users/93dbc427f149499fbb2bb7233c94b46c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:42:28.428681 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:28.429210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:28.429320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:28.449359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:28.451269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:28.500858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:28.513670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1092/2221] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:28.525402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:28.526848 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:28.584690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa17d0-e05d-4796-8ce0-db092fc8a85e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:28.588572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:28.589544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:28.589544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:28.589757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:28.599624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:28.601134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6204d-d2ce-483d-a5da-a3ff07d69d37 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:28.610982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1130/2222] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:28.889268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:28.890722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:28.902291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba00a-eac1-442b-9bbb-da4a0846b01c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:28.907374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:28.907985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:28.908261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:28.908526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] PATH_INFO: `/v3/projects/f54fc9931a0c4c8a8dd10f9b32997a4b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:28.909800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54fc9931a0c4c8a8dd10f9b32997a4b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:28.911680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:28.961127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54fc9931a0c4c8a8dd10f9b32997a4b', 'request_id': 'req-65cddce2-b2c3-42d4-b5ee-282be1f372b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.966982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54fc9931a0c4c8a8dd10f9b32997a4b', 'request_id': 'req-65cddce2-b2c3-42d4-b5ee-282be1f372b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.973007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54fc9931a0c4c8a8dd10f9b32997a4b', 'request_id': 'req-65cddce2-b2c3-42d4-b5ee-282be1f372b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.985056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] The token cache is being invalidate because project f54fc9931a0c4c8a8dd10f9b32997a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:42:28.985344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.985938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:42:28.987463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1093/2223] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:42:28 2022] DELETE /identity/v3/projects/f54fc9931a0c4c8a8dd10f9b32997a4b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:42:38.606523 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:38.982028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:43.757516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:43.757990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:43.758108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:43.777199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:43.778377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:43.835059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1131/2224] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:43.876709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:43.878134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:43.949035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cddce2-b2c3-42d4-b5ee-282be1f372b3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:43.954697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:43.955327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:43.955609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:43.955878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:43.964066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:43.965671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:43.973945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1094/2225] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:42:53.825716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=25 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:53.970571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=32 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:54.301699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:54.303116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:54.359237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a6b8-acca-4fb9-a6e6-b16171996397 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:54.362768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:54.363430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:54.363708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:54.363978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:54.365666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:54.374827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:54.376286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa20d14-fd06-41b2-8f52-8560e3994532 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:54.384296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1132/2226] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:57.742368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:57.751444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619710-9a69-4243-b995-4230d1c9d054 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:57.754915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:57.755522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:57.755796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:57.756062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:57.757744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:57.767316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:57.768709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b8bb-bf1d-4e2e-a65c-959670178215 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:57.776287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1095/2227] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:57.895144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:57.895725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:57.895725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:57.897027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1133/2228] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:57.903529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a30d-46cf-442c-9ed5-2be3ef7ee419 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:57.903900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a30d-46cf-442c-9ed5-2be3ef7ee419 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:57.904261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a30d-46cf-442c-9ed5-2be3ef7ee419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:57.924600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5975a30d-46cf-442c-9ed5-2be3ef7ee419 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:57.925913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5975a30d-46cf-442c-9ed5-2be3ef7ee419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:57.992921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1096/2229] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:42:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:58.004145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.005815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.062830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7c08b-793f-4770-af7d-a2408d109089 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.066283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.066869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.067140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.067434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.077071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.078482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2efe11-26f8-426c-b8a6-b7d93ae2fea1 service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.089158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1134/2230] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:58.161321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.161595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.161877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.163361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1097/2231] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 20:42:58.168291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.168576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.168847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.188615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] MFA Rules not processed for user `21d525a5c45e472e8e5f56d15b43df0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:58.189810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.196979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1135/2232] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:42:58.211100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.213278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.213763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.216039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.228961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459134a-e85c-41e0-a67d-71e4fecdb57d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.233237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.234269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c43f85-fd22-4f22-b8c2-f8cad71d9213 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.235045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.235520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.236080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.240499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.241075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.241354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.241628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.243662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.244984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.246412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.254939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1136/2233] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:42:58.258858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.260687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30294583-8286-4626-bee3-50c085f92a95 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.272430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1098/2234] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:58.303056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.305168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.322553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24484-97d4-4813-bfab-af4f05545045 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.328253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.328859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.329126 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.329394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.331119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.349008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2022-92bb-4a37-964e-9397436e19c1 None None] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.349288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2022-92bb-4a37-964e-9397436e19c1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.349561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f2022-92bb-4a37-964e-9397436e19c1 None None] PATH_INFO: `/` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.350897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1099/2235] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 20:42:58.355873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.356254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.356604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.376762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] MFA Rules not processed for user `54e2221204ff4332ba980b9c5779b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:42:58.377968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.389023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1100/2236] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 20:42:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:42:58.394266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.395991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.400012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.406263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1137/2237] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:42:58.410020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b26c-b73c-4dc4-bc95-6120daf5d313 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.414057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.414648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.414919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.415183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.425966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.427467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82315ca4-7865-4d01-8380-7e9d4435ad37 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.438863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1101/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:42:58.505646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:42:58.507295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.536699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:42:58.581669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022784-159f-42c1-9871-6144140f0c73 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:42:58.584931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:42:58.585571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:42:58.585875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:42:58.586389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:42:58.587958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:42:58.603438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:42:58.605342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:42:58.616278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1138/2239] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:42:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:08.433539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=52 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:08.440126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:08.440402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:08.440670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:08.459633 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:08.460779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:08.467735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1102/2240] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:43:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:43:08.480125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:08.492180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa0284-9b62-45a8-835d-e91b22c4737a service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:08.497173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:08.497759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:08.498036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:08.498303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:08.506248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:08.507890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:08.515794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1139/2241] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:43:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:43:12.236386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:12.251454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba4c39-a146-4699-a7be-c7fea17f17bc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:12.257059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:12.257673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:12.257951 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:12.258229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:12.260052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:12.325588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:12.327977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:12.345114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1103/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:18.512595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=27 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:22.340182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=31 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:24.313404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:24.325405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f0e7-eef1-429d-8244-87e0820a1e83 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:24.331677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:24.332398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:24.332744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:24.333089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:24.335272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:24.396513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:24.398107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd5cc-8b3c-44d7-857a-dcae24cd07f1 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:24.407954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1140/2243] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:27.136395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:27.149763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf818c-2779-4cdf-bc79-fff17c6d1036 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:27.155814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:27.156410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:27.156688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:27.157078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:27.158833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:27.172517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:27.174102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:27.185740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1104/2244] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:30.653055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54b5f-eb12-4b42-b958-ecaf053ea176 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:30.653617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54b5f-eb12-4b42-b958-ecaf053ea176 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:30.653617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb54b5f-eb12-4b42-b958-ecaf053ea176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:30.672789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bcb54b5f-eb12-4b42-b958-ecaf053ea176 None None] MFA Rules not processed for user `919c94bd42144c9b86fd9977e85b0762`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:30.674132 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bcb54b5f-eb12-4b42-b958-ecaf053ea176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:30.681029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1141/2245] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:43:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:37.182243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:38.072962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:38.087288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea92373-d189-4a17-b6fc-9b91bd8191bc service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:38.094129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:38.094989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:38.095288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:38.095562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:38.097832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:38.111695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:38.113281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:38.125029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1105/2246] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:39.644907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1efb-3378-4e69-884a-7e659403d25a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.645434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1efb-3378-4e69-884a-7e659403d25a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.645434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1efb-3378-4e69-884a-7e659403d25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.679497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-742e1efb-3378-4e69-884a-7e659403d25a None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:39.680851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-742e1efb-3378-4e69-884a-7e659403d25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:39.688947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1142/2247] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:43:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:39.702201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:39.713840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00abb-6791-4077-b031-4f186116f795 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:39.719827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:39.720454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:39.720729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:39.720998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:39.729356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:39.730918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:39.739747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1106/2248] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:43:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:43:42.464669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:42.465161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:42.465261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:42.483578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] MFA Rules not processed for user `28a58d55f9cc42c7a041884eee0ea248`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:43:42.484757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:42.491613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1143/2249] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:43:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:43:42.806771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:43:42.816744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605be23e-19cf-409a-abf1-ac4a8a6622f5 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:43:42.820323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:43:42.820921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:43:42.821180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:43:42.821452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:43:42.823339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:43:42.834537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:43:42.836168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d52d56-7c25-418c-9dc7-a64244a34bb2 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:43:42.844547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1107/2250] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:43:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:43:52.478426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=37 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:43:52.840799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=18 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:45.774742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:44:45.787817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8dacc-949a-4b2f-b89e-ae108ddafab3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:44:45.793073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:44:45.793659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:45.793929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:45.794194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:45.795957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:45.853042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:44:45.854552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53562ba-90a9-4ff0-baac-d932b01b563e service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:44:45.864008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1144/2251] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:44:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:44:55.860517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=28 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:44:57.201060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7a28-1035-412a-943f-30b88517663d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:57.201906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7a28-1035-412a-943f-30b88517663d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:57.202227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7a28-1035-412a-943f-30b88517663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:57.225269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-88ff7a28-1035-412a-943f-30b88517663d None None] MFA Rules not processed for user `86090cd4247d4d598eb1976f4224b4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:57.226564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-88ff7a28-1035-412a-943f-30b88517663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:57.234131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1108/2252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:44:57.965781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:44:57.966348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:44:57.966447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:44:57.985503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] MFA Rules not processed for user `8dcb94f981244d569f1dd791a4d911ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:44:57.986693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:44:57.993636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1145/2253] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:44:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:00.100263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7a28-1035-412a-943f-30b88517663d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:00.116105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7a28-1035-412a-943f-30b88517663d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:00.120558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:00.121473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:00.122035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:00.122573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:00.125408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:00.191758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:00.193188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:00.203798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1109/2254] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:03.861925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:03.884805 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42c690-e959-40c6-a16a-bef94bff9929 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:03.887415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:03.890061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:03.892068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:03.892688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:03.892962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:03.893438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:03.895443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:03.904075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4571-ab23-42a5-9980-20063d326c48 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:03.909559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:03.910909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:03.911835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:03.911953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:03.912436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:03.912914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] PATH_INFO: `/v3/users/919c94bd42144c9b86fd9977e85b0762` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:03.914238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919c94bd42144c9b86fd9977e85b0762)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:03.916650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:03.923156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1146/2255] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:03.983233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919c94bd42144c9b86fd9977e85b0762'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:03.991617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919c94bd42144c9b86fd9977e85b0762'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:03.999973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919c94bd42144c9b86fd9977e85b0762'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.017626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919c94bd42144c9b86fd9977e85b0762'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.017626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ef2f133d-3ee7-452d-bdaa-a29eaa434a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919c94bd42144c9b86fd9977e85b0762'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.019357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1110/2256] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:45:03 2022] DELETE /identity/v3/users/919c94bd42144c9b86fd9977e85b0762 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:45:04.203855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.216696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b27160-a91a-4413-9c89-c0641e99069e service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.282782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.283431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.283712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.284011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] PATH_INFO: `/v3/projects/7e2bf24478c34b9088fb7cfaa0affb97` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.285112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2bf24478c34b9088fb7cfaa0affb97)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.287003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.332443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2bf24478c34b9088fb7cfaa0affb97', 'request_id': 'req-e1d94491-f285-49f0-81cc-8de55bbd212e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.338196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2bf24478c34b9088fb7cfaa0affb97', 'request_id': 'req-e1d94491-f285-49f0-81cc-8de55bbd212e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.344747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2bf24478c34b9088fb7cfaa0affb97', 'request_id': 'req-e1d94491-f285-49f0-81cc-8de55bbd212e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.357217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] The token cache is being invalidate because project 7e2bf24478c34b9088fb7cfaa0affb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:45:04.357499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.358168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e1d94491-f285-49f0-81cc-8de55bbd212e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:04.359726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1147/2257] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:45:04 2022] DELETE /identity/v3/projects/7e2bf24478c34b9088fb7cfaa0affb97 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:04.364766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.365052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.365328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.384403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:04.385532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:04.437707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:04.448164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1111/2258] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:04.456057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.456346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.456720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.476263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:04.477434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:04.485760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1148/2259] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:04.489814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.499819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140ee95-1add-4f37-b0d6-bf19ba69a4a2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.504294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.504876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.505148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.505411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.506040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:45:04.506332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.507931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.518938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1112/2260] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:45:04.523323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.532321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011863e6-4210-4ed5-b2ec-b3ba6207952f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.536858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.537418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.537690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.537956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.538576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.540509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.567328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1149/2261] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:04.571459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.581507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8b41c-ed85-44ac-bd64-cd1ce3754796 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.637399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.637927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.638228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.638498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.639117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.641048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.661095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1113/2262] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:04.665328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.676133 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f090-adf2-4685-b50d-2a0977cc3e73 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.680693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.681280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.681554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.681820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.682447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.684139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.693901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1150/2263] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:04.697920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.708596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020e032-591b-4472-8969-f4333cbc39b3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.713634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.714222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.714502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.715409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.716051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.717625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275e33c-b85e-480b-8508-561a23057b5d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.727890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1114/2264] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:04.731919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.741563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb538b-3e88-4c6f-85b5-68b9828783c7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.746851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.747550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.747845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.748111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] PATH_INFO: `/v3/projects/f8312b750d784a229094f61d5d2cf515/users/110609264cec48509067c096aac13bea/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.763852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8312b750d784a229094f61d5d2cf515, user_id=110609264cec48509067c096aac13bea, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.766445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.780027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1151/2265] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:04 2022] PUT /identity/v3/projects/f8312b750d784a229094f61d5d2cf515/users/110609264cec48509067c096aac13bea/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:45:04.790864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.791170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.791470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.819000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] MFA Rules not processed for user `110609264cec48509067c096aac13bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:04.820228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:04.887087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1115/2266] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:04.891599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:04.900176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:04.953787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb3caa-109a-4531-b2d7-bd6f5274f9c3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:04.958431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:04.959022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:04.959335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:04.959860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:04.960464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:04.962340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:04.988812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1152/2267] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:04.992848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.003207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974d75-d992-4cf7-9934-002b4d556c61 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.051624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:05.059494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.060096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.060377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.060653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.061281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.063194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.083927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1116/2268] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:04 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:45:05.087597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.098165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c08f7-34d5-448d-8bc1-c234be14fbcb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.102726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.103349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.103629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.103919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.104547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.107690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.125934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1153/2269] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:45:05.130705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.141675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da440a-b79b-46c1-a5ec-dea18d0ec066 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.146323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.146976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.147276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.147551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] PATH_INFO: `/v3/projects/25f9029607724563b25dd7e170e71d70/users/5b6eed9ad88a4ff2b8a9498b65931898/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.164782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f9029607724563b25dd7e170e71d70, user_id=5b6eed9ad88a4ff2b8a9498b65931898, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.168638 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.185806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1117/2270] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:05 2022] PUT /identity/v3/projects/25f9029607724563b25dd7e170e71d70/users/5b6eed9ad88a4ff2b8a9498b65931898/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:05.191388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.204129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb7e0-823f-4129-ae23-562c2f933253 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.262835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.263472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.263748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.264015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.264649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.266227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987bbb9-66a0-46f8-9473-ab1dd41b7978 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.276284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1154/2271] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:05.281121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.293051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2951a7-1259-49b5-a87b-40c48abf89f5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.297802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.298559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.298897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.299233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] PATH_INFO: `/v3/projects/25f9029607724563b25dd7e170e71d70/users/5b6eed9ad88a4ff2b8a9498b65931898/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.301240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f9029607724563b25dd7e170e71d70, user_id=5b6eed9ad88a4ff2b8a9498b65931898, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.304075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.330673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1118/2272] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:05 2022] PUT /identity/v3/projects/25f9029607724563b25dd7e170e71d70/users/5b6eed9ad88a4ff2b8a9498b65931898/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:05.342067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.342348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.342616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.371728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] MFA Rules not processed for user `5b6eed9ad88a4ff2b8a9498b65931898`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:05.372911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:05.441243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1155/2273] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:05.452367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.454136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:05.510575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54363b90-1f85-4d62-beb9-7efc803f3f00 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.514234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.514818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.515092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.515390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.524072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.525517 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.535235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1119/2274] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:05.611479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:05.616127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:05.622881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15559-0197-4bb6-8a81-139ba1609033 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:05.626657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:05.627270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:05.627550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:05.627823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:05.682331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:05.684321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c0af9-bcdc-4ee0-a0e6-c552ce75301a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:05.693032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1156/2275] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:15.531097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:15.689001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=27 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:38.525962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:38.527472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:38.708964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4df37-4ea5-4e6c-9b15-ac12668244ce service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:38.714543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:38.715141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:38.715444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:38.715713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:38.717450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:38.729540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:38.731524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:38.743206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1120/2276] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:41.529226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7fe8-224d-47e9-965a-a187ca1ded2a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:41.529742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7fe8-224d-47e9-965a-a187ca1ded2a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:41.529843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a7fe8-224d-47e9-965a-a187ca1ded2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:41.548592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d87a7fe8-224d-47e9-965a-a187ca1ded2a None None] MFA Rules not processed for user `28a58d55f9cc42c7a041884eee0ea248`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:41.549804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d87a7fe8-224d-47e9-965a-a187ca1ded2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:41.608066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1157/2277] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:48.738892 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=63 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:51.487078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:51.576972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329fb9-ac2c-40ce-9508-f38eb7ee1337 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:51.582134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:51.582763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:51.583445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:51.583445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] PATH_INFO: `/v3/users/110609264cec48509067c096aac13bea` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:51.584488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110609264cec48509067c096aac13bea)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:51.589262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:51.601256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=25 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:51.639338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110609264cec48509067c096aac13bea'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:51.647365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110609264cec48509067c096aac13bea'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:51.656038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110609264cec48509067c096aac13bea'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:51.667759 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110609264cec48509067c096aac13bea'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:51.668403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110609264cec48509067c096aac13bea'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:51.674131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1121/2278] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:45:51 2022] DELETE /identity/v3/users/110609264cec48509067c096aac13bea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:51.678563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:51.678874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:51.679143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:51.718428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:51.719649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:51.777007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1158/2279] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:51.787788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:51.789215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:51.858263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:51.868726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875845e-68e3-46a1-87b8-57e9e9ed3e73 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:51.872420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:51.873022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:51.873298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:51.873567 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:51.882337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:51.883843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:51.893470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1122/2280] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:52.156647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:52.158080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:52.170342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40a31-7a5f-4c1c-af89-bf9fa0ae2ba8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:52.175383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:52.176013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:52.176293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:52.176564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] PATH_INFO: `/v3/projects/f8312b750d784a229094f61d5d2cf515` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:52.177699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8312b750d784a229094f61d5d2cf515)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:52.179635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:52.227237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8312b750d784a229094f61d5d2cf515', 'request_id': 'req-2aa413df-4846-4b74-b0e8-186d04fdcc97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.232785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8312b750d784a229094f61d5d2cf515', 'request_id': 'req-2aa413df-4846-4b74-b0e8-186d04fdcc97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.239043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8312b750d784a229094f61d5d2cf515', 'request_id': 'req-2aa413df-4846-4b74-b0e8-186d04fdcc97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.251629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] The token cache is being invalidate because project f8312b750d784a229094f61d5d2cf515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:45:52.251967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.252625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.254141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1159/2281] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:45:52 2022] DELETE /identity/v3/projects/f8312b750d784a229094f61d5d2cf515 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:52.258711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:52.269548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668eab5-6802-4cb5-8648-ab5815265557 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:52.324647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:52.325268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:52.325548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:52.325832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] PATH_INFO: `/v3/users/5b6eed9ad88a4ff2b8a9498b65931898` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:52.326968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6eed9ad88a4ff2b8a9498b65931898)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:52.328935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:52.373839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6eed9ad88a4ff2b8a9498b65931898'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.381080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6eed9ad88a4ff2b8a9498b65931898'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.388179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6eed9ad88a4ff2b8a9498b65931898'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.401344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6eed9ad88a4ff2b8a9498b65931898'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.401910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f46a388-8273-418d-a4a4-cfd4120af425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6eed9ad88a4ff2b8a9498b65931898'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.407680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1123/2282] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:45:52 2022] DELETE /identity/v3/users/5b6eed9ad88a4ff2b8a9498b65931898 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:45:52.681488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:52.683013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:52.698708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa413df-4846-4b74-b0e8-186d04fdcc97 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:52.761253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:52.761883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:52.762158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:52.762425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] PATH_INFO: `/v3/projects/25f9029607724563b25dd7e170e71d70` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:52.763558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f9029607724563b25dd7e170e71d70)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:52.767715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:52.778920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:52.820942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f9029607724563b25dd7e170e71d70', 'request_id': 'req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.826722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f9029607724563b25dd7e170e71d70', 'request_id': 'req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.833516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f9029607724563b25dd7e170e71d70', 'request_id': 'req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.847387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] The token cache is being invalidate because project 25f9029607724563b25dd7e170e71d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:45:52.847670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.848276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-778f3012-1cb0-44b4-a8ed-1d87cb8dc5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:52.849772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1160/2283] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:45:52 2022] DELETE /identity/v3/projects/25f9029607724563b25dd7e170e71d70 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:52.859615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:52.859615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:52.859615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:52.902374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:52.903589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:52.936717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:52.963586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1124/2284] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:52.971667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:52.971951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:52.972230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:52.991790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:52.992984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.000761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1161/2285] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:53.004697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.014272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619c8c5-a4d1-46a1-aa09-f97001708d26 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.019290 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.019872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.020147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.020411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.021041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:45:53.021337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.022900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.034479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1125/2286] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:45:53.038450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.047495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fadb8-9d72-4392-8a45-cbaad6a15b4c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.052077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.052657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.052932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.053200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.053810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.055735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.082263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1162/2287] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:53.086446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.096672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f425eb-cfe4-4c35-bae8-c5340f32de73 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.152596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.153186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.153461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.153727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.154351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.156789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.177479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1126/2288] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:45:53.181591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.191922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99a2c-0858-4b8f-a235-1d52ae6bba3f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.196434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.197018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.197295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.197564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.198188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.199798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.209946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1163/2289] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:53.213903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.224102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56527c-0bb7-422b-a2f6-26100fced24c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.228660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.229231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.229504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.229770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.230395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.231994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6ab6d-cf81-48fd-9340-c0d471908bfd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.242431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1127/2290] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:53.246624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.256394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3aa19f-0964-4c5b-98ed-4049a2d387d9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.261019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.261655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.261933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.262203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] PATH_INFO: `/v3/projects/817a7ed8ef82423f9b72073ef56a8fcb/users/d9ed9795d44342e0be19bd96d82713f6/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.278046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817a7ed8ef82423f9b72073ef56a8fcb, user_id=d9ed9795d44342e0be19bd96d82713f6, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.281361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.294811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1164/2291] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:53 2022] PUT /identity/v3/projects/817a7ed8ef82423f9b72073ef56a8fcb/users/d9ed9795d44342e0be19bd96d82713f6/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:53.305227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.305512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.305786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.332817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] MFA Rules not processed for user `d9ed9795d44342e0be19bd96d82713f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:53.334048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.400511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1128/2292] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:53.404995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.469745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382ad89-e3ab-4ff6-8748-1201b57ebb49 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.474906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.475649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.475982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.476295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.476931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.478835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.509312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1165/2293] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:53.510536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.522250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3132-b62e-4db4-b764-b40f2adcc0f0 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.554766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.583016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.583669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.583944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.584208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.584836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.587004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.609181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1129/2294] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:45:53.613343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.623758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525efa-6c26-4b32-91a5-0dcff7a8dfc1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.632279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.632877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.633157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.633424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.634056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.635688 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.648847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1166/2295] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:53.653017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.665845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987e972-0fba-4a8a-8f4b-5f333d98b5ff admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.670532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.671173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.671487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.671757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] PATH_INFO: `/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876/users/08cc7c6af79b49c385d563cc25c292ee/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.687742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c69f3b0a5c047e5b6c69fc1abc23876, user_id=08cc7c6af79b49c385d563cc25c292ee, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.690414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.703340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1130/2296] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:53 2022] PUT /identity/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876/users/08cc7c6af79b49c385d563cc25c292ee/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:53.707276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.717694 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48554ba-5883-4e45-a588-56e9a21ff312 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.721251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:53.776189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.776801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.777067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.777338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.778002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.779631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7be5bc-3966-4e44-ac7a-8b62e7844d45 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.791599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1167/2297] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:53.795585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.806274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b2d55-d37e-4b72-a7bf-6263cedc4588 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:53.810829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:53.812111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.812401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.812656 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] PATH_INFO: `/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876/users/08cc7c6af79b49c385d563cc25c292ee/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.814553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c69f3b0a5c047e5b6c69fc1abc23876, user_id=08cc7c6af79b49c385d563cc25c292ee, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:53.817208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:53.827261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1131/2298] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:53 2022] PUT /identity/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876/users/08cc7c6af79b49c385d563cc25c292ee/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:53.838549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:53.838841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:53.839120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:53.869563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] MFA Rules not processed for user `08cc7c6af79b49c385d563cc25c292ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:53.870845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:53.959518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1168/2299] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:53.973412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:53.975931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:54.064118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f4e24-93e1-421a-9be9-8b54a8e43716 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:54.067870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:54.068467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:54.068742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:54.069007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:54.077774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:54.079180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fb15e-10b0-4bcd-aa6a-f9fccbb3221a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:54.088644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1132/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:55.571206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:55.648734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4eae6-8218-4c24-81cd-5fb6eab176a3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:55.653323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:55.653958 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:55.654234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:55.654536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] PATH_INFO: `/v3/users/d9ed9795d44342e0be19bd96d82713f6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:55.656206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ed9795d44342e0be19bd96d82713f6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:55.658202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:55.691784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:55.706270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ed9795d44342e0be19bd96d82713f6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:55.714006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ed9795d44342e0be19bd96d82713f6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:55.723231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ed9795d44342e0be19bd96d82713f6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:55.724259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ed9795d44342e0be19bd96d82713f6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:55.738008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ed9795d44342e0be19bd96d82713f6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:55.743862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1169/2301] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:45:55 2022] DELETE /identity/v3/users/d9ed9795d44342e0be19bd96d82713f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:55.748355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:55.748864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:55.749051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:55.768532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:55.769786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:55.832232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1133/2302] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:55.842204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:55.844148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:55.905785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3bd6a-7688-4fe5-9c95-1035764b89e8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:55.909570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:55.910170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:55.910447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:55.910716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:55.919970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:55.922085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:55.931677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1170/2303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:56.199509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:56.200954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:56.214545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d786c-29ae-41df-9789-e8508ecf6a0d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:56.218849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:56.219524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.219798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.220080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] PATH_INFO: `/v3/projects/817a7ed8ef82423f9b72073ef56a8fcb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.221729 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=817a7ed8ef82423f9b72073ef56a8fcb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:56.223773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:56.231279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:56.274921 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817a7ed8ef82423f9b72073ef56a8fcb', 'request_id': 'req-f4421a6f-c38a-4d21-8795-28b05a8ce08c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.284115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817a7ed8ef82423f9b72073ef56a8fcb', 'request_id': 'req-f4421a6f-c38a-4d21-8795-28b05a8ce08c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.290402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817a7ed8ef82423f9b72073ef56a8fcb', 'request_id': 'req-f4421a6f-c38a-4d21-8795-28b05a8ce08c'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.304046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] The token cache is being invalidate because project 817a7ed8ef82423f9b72073ef56a8fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:45:56.304456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.305168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.309515 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1134/2304] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:45:56 2022] DELETE /identity/v3/projects/817a7ed8ef82423f9b72073ef56a8fcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:56.310700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:56.320495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84923304-439f-4308-82da-b5a1c5517957 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:56.379814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:56.380447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.380726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.381000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] PATH_INFO: `/v3/users/08cc7c6af79b49c385d563cc25c292ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.382123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cc7c6af79b49c385d563cc25c292ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:56.384064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:56.429004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cc7c6af79b49c385d563cc25c292ee'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.433403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:56.436978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cc7c6af79b49c385d563cc25c292ee'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.445114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cc7c6af79b49c385d563cc25c292ee'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.445797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cc7c6af79b49c385d563cc25c292ee'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.458223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4df72c1b-eec1-4792-9d41-d249928c84fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cc7c6af79b49c385d563cc25c292ee'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.464604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1171/2305] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:45:56 2022] DELETE /identity/v3/users/08cc7c6af79b49c385d563cc25c292ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:56.744834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:56.746421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:56.760636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4421a6f-c38a-4d21-8795-28b05a8ce08c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:56.817866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:56.818487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.818763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.819032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] PATH_INFO: `/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.820149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c69f3b0a5c047e5b6c69fc1abc23876)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:56.822031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:56.866956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c69f3b0a5c047e5b6c69fc1abc23876', 'request_id': 'req-3c668a7f-aacd-4264-9e0c-2e3c359df2db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.872472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c69f3b0a5c047e5b6c69fc1abc23876', 'request_id': 'req-3c668a7f-aacd-4264-9e0c-2e3c359df2db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.879087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c69f3b0a5c047e5b6c69fc1abc23876', 'request_id': 'req-3c668a7f-aacd-4264-9e0c-2e3c359df2db'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.891230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] The token cache is being invalidate because project 9c69f3b0a5c047e5b6c69fc1abc23876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:45:56.891541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.892223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3c668a7f-aacd-4264-9e0c-2e3c359df2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:45:56.893794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1135/2306] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:45:56 2022] DELETE /identity/v3/projects/9c69f3b0a5c047e5b6c69fc1abc23876 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:56.898577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.899030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.899121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:56.918087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:56.919299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:56.977136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1172/2307] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:56.985918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:56.986187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:56.986459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.006150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:57.007369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:57.015020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1136/2308] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:57.019067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.028772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944a19a-ca4a-45b2-91d8-3e87949cd577 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.033373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.033963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.034243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.034515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.035158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:45:57.035491 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.037082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.048799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1173/2309] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:45:57.052917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.062516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ae79b-48e8-4934-bc69-da665f3adbc9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.067127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.067735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.068055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.068274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.068905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.070756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.086208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:57.099042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1137/2310] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:57.102941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.113307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0bde-778c-4b1e-adeb-66936e865632 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.168750 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.169362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.169682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.169950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.170556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.173073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.193160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1174/2311] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:57.197370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.207230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427cac-db8b-4f48-a6c3-98f409958248 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.212010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.212591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.212864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.213128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.213762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.215342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.225368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1138/2312] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:57.229078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.239433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1afed2-3234-4475-b110-79475913002b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.243886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.244458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.244733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.244999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.245649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.247207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b89b6-6c36-499f-b2ad-0722506f1816 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.258125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1175/2313] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:45:57.261417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.271406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ab35-046b-4c72-aa48-2cb333c8ae86 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.275970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.276606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.276881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.277150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] PATH_INFO: `/v3/projects/0c1ce623791d4a53a0edd0aeb6b5e383/users/baada828b54b49c6ba9957aeb32f4622/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.292441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c1ce623791d4a53a0edd0aeb6b5e383, user_id=baada828b54b49c6ba9957aeb32f4622, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.295160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.311033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1139/2314] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:57 2022] PUT /identity/v3/projects/0c1ce623791d4a53a0edd0aeb6b5e383/users/baada828b54b49c6ba9957aeb32f4622/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:57.322229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.322529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.322873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.350425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] MFA Rules not processed for user `baada828b54b49c6ba9957aeb32f4622`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:57.351650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:57.375041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:57.418372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1176/2315] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:57.423721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.485653 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5058721-c223-468c-9fdd-aa357a661724 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.490365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.490963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.491238 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.491530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.492155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.494036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.521871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1140/2316] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:57.525923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.537175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d00fde-012d-4251-8ce1-2876c96d3e6f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.593838 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.594377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.594653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.594921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.595605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.597512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.618546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1177/2317] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:45:57.622513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.633444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59fc9-4534-4005-8350-6585f1076d28 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.638043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.638628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.639372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.639372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.639917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.641507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.652688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1141/2318] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:57.656859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.666969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed480b-730d-413c-ad2d-4ced50ac812d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.672074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.672703 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.672976 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.673243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] PATH_INFO: `/v3/projects/3c1661935afa4581b152ea7fbb77e8bd/users/06448d1489aa42968550df39ee8459d1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.688467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1661935afa4581b152ea7fbb77e8bd, user_id=06448d1489aa42968550df39ee8459d1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.691099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.703772 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1178/2319] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:57 2022] PUT /identity/v3/projects/3c1661935afa4581b152ea7fbb77e8bd/users/06448d1489aa42968550df39ee8459d1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:57.707758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.717661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14017-ae8d-48f3-8985-ad24c3ea480d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.773662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.774372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.774529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.774798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.775473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.777039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0cf0f-a65a-41a7-ab3c-bdcf936d8c26 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.788284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1142/2320] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:45:57.792527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.803104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2e00d-1077-497f-ace6-543985a6257e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:57.807779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:57.808424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.808701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.808974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] PATH_INFO: `/v3/projects/3c1661935afa4581b152ea7fbb77e8bd/users/06448d1489aa42968550df39ee8459d1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.810846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c1661935afa4581b152ea7fbb77e8bd, user_id=06448d1489aa42968550df39ee8459d1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:57.813489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:57.824127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1179/2321] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:45:57 2022] PUT /identity/v3/projects/3c1661935afa4581b152ea7fbb77e8bd/users/06448d1489aa42968550df39ee8459d1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:45:57.835507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:57.835794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:57.836064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:57.864112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] MFA Rules not processed for user `06448d1489aa42968550df39ee8459d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:45:57.865233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:57.883966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:45:57.935121 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1143/2322] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:45:57.946026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:57.947886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:45:58.005494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81717c1-f7ce-4302-996d-4ab8f915a3eb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:58.009056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:58.009642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:58.009913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:58.010176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:58.018816 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:58.020248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:58.029408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1180/2323] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:45:58.103505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:45:58.113469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb063518-9fd7-4ac8-8be0-88c52e2bc26c None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:45:58.117089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:45:58.117627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:45:58.117904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:45:58.118175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:45:58.174082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:45:58.175664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a9331-0c0f-457b-af0a-46f3e1ae5c4b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:45:58.184771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1144/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:45:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:02.245997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.267048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:02.310187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22c040-f5bf-4a0c-8c2a-643f5c62e67b service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:02.315286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:02.315903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.316176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.316440 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] PATH_INFO: `/v3/users/baada828b54b49c6ba9957aeb32f4622` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.317527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baada828b54b49c6ba9957aeb32f4622)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:02.319464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:02.377020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baada828b54b49c6ba9957aeb32f4622'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.383789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baada828b54b49c6ba9957aeb32f4622'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.391324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baada828b54b49c6ba9957aeb32f4622'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.392028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baada828b54b49c6ba9957aeb32f4622'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.404820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baada828b54b49c6ba9957aeb32f4622'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.411114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1181/2325] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:02 2022] DELETE /identity/v3/users/baada828b54b49c6ba9957aeb32f4622 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:02.415547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af917-d176-4920-901e-85f8b37f248a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.416005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af917-d176-4920-901e-85f8b37f248a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.416128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af917-d176-4920-901e-85f8b37f248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.437648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-801af917-d176-4920-901e-85f8b37f248a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:02.438867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-801af917-d176-4920-901e-85f8b37f248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.495786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1145/2326] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:02.505279 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.506661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.563016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcd9ed-2219-4e5f-854a-d38e9e7d9b86 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:02.566675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:02.567370 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.567669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.567959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.577060 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:02.578480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:02.588478 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1182/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:02.864289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af917-d176-4920-901e-85f8b37f248a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.865698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-801af917-d176-4920-901e-85f8b37f248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:02.878538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af917-d176-4920-901e-85f8b37f248a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:02.883262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:02.883946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:02.884350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:02.884625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] PATH_INFO: `/v3/projects/0c1ce623791d4a53a0edd0aeb6b5e383` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:02.885871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c1ce623791d4a53a0edd0aeb6b5e383)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:02.887701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:02.937178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c1ce623791d4a53a0edd0aeb6b5e383', 'request_id': 'req-3e15b35f-09c0-42f1-a626-7bdbd28e2677'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.938313 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:02.943853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c1ce623791d4a53a0edd0aeb6b5e383', 'request_id': 'req-3e15b35f-09c0-42f1-a626-7bdbd28e2677'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.950405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c1ce623791d4a53a0edd0aeb6b5e383', 'request_id': 'req-3e15b35f-09c0-42f1-a626-7bdbd28e2677'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.963051 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] The token cache is being invalidate because project 0c1ce623791d4a53a0edd0aeb6b5e383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:02.963367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.963982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:02.965460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1146/2328] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:02 2022] DELETE /identity/v3/projects/0c1ce623791d4a53a0edd0aeb6b5e383 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:02.970574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:02.982453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48e4d-87fb-424e-9be8-69ce8534a663 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.023905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:03.041180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.041799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.042076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.042349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] PATH_INFO: `/v3/users/06448d1489aa42968550df39ee8459d1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.043483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06448d1489aa42968550df39ee8459d1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.045390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.089745 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06448d1489aa42968550df39ee8459d1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.097136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06448d1489aa42968550df39ee8459d1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.104553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06448d1489aa42968550df39ee8459d1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.105238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06448d1489aa42968550df39ee8459d1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.119145 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-725e502d-b26e-406c-8b6c-637a042c50e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06448d1489aa42968550df39ee8459d1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.125233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1183/2329] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:02 2022] DELETE /identity/v3/users/06448d1489aa42968550df39ee8459d1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:03.395453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.397054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:03.412045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15b35f-09c0-42f1-a626-7bdbd28e2677 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.468714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.469405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.469598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.469859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] PATH_INFO: `/v3/projects/3c1661935afa4581b152ea7fbb77e8bd` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.471006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c1661935afa4581b152ea7fbb77e8bd)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.472854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.518172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1661935afa4581b152ea7fbb77e8bd', 'request_id': 'req-a5b226d0-2177-4e33-b870-a20b44169b9b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.523612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1661935afa4581b152ea7fbb77e8bd', 'request_id': 'req-a5b226d0-2177-4e33-b870-a20b44169b9b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.529536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1661935afa4581b152ea7fbb77e8bd', 'request_id': 'req-a5b226d0-2177-4e33-b870-a20b44169b9b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.541447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] The token cache is being invalidate because project 3c1661935afa4581b152ea7fbb77e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:03.541730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.542335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a5b226d0-2177-4e33-b870-a20b44169b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:03.543813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1147/2330] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:03 2022] DELETE /identity/v3/projects/3c1661935afa4581b152ea7fbb77e8bd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:46:03.549040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.549492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.549583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.568590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:03.569800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:03.628529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1184/2331] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:03.636295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.636587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.636864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.657429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:03.658609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:03.666420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1148/2332] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:03.670590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.680158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641e177-82f2-467e-88da-7a6a67fe4fc8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.684709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.685290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.685564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.685831 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.686464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:46:03.686760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.688366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.699480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1185/2333] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:46:03.703928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.713200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dda622-30f9-4fd2-a214-3b9d121e9293 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.718480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.719063 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.719374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.719645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.720342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.722264 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.748070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1149/2334] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:03.752103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.761933 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78fdd9-4cac-4d57-a57d-8ca094af607a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.806038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:03.819744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.820331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.820609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.820880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.821494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.823494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.845775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1186/2335] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:03.850079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.860192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2de0b-983e-4bd7-9753-d6abe29811fa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.864733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.865319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.865596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.865866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.866499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.868185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.878223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1150/2336] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:03.882044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.892497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc768102-3ad8-4e7a-8a33-3ccfc59d5322 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.897152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.897739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.898016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.898286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.898917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.900531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ef6f-b882-48a4-869e-f851277e13bb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.911557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1187/2337] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:03.915540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:03.925345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158743d9-3c7f-41ec-a4c1-d54df39a334f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:03.929916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:03.930547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.930820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.931088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] PATH_INFO: `/v3/projects/382e16532eae455a9ffcad1197a6d169/users/0d5f04595d6e499fa3efa09ffa0e1690/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:03.947496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] RBAC: Authorizing `identity:create_grant(project_id=382e16532eae455a9ffcad1197a6d169, user_id=0d5f04595d6e499fa3efa09ffa0e1690, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:03.950144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:03.962845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1151/2338] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:03 2022] PUT /identity/v3/projects/382e16532eae455a9ffcad1197a6d169/users/0d5f04595d6e499fa3efa09ffa0e1690/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:46:03.974882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:03.975102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:03.975419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.002589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] MFA Rules not processed for user `0d5f04595d6e499fa3efa09ffa0e1690`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:04.003812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:04.067828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1188/2339] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:04.072402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.077873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:04.132609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db093bce-daff-4842-b14e-90575845c85d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.137208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.137779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.138054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.138318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.138922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.140854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.166174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1152/2340] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:04 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:04.170385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.181600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4ef77-99e1-4792-bbd1-809349256ad3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.236678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.237209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.237482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.237747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.238346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.240274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.260393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1189/2341] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:04 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:46:04.264916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.275042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66322a8e-c4a4-4fa4-8e3f-29b898b666f5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.279637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.280805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.281081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.281347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.281978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.283590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.293711 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1153/2342] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:04.297648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.307455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ad8b-fbfb-4f3a-bb32-39937f6c1ec2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.312291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.312996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.313270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.313534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] PATH_INFO: `/v3/projects/fef3e775177b4a3296aa9d41978ae631/users/d40d3ca8c3974dbf8268a981ab8ed2e0/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.330339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3e775177b4a3296aa9d41978ae631, user_id=d40d3ca8c3974dbf8268a981ab8ed2e0, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.332998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.346654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1190/2343] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:04 2022] PUT /identity/v3/projects/fef3e775177b4a3296aa9d41978ae631/users/d40d3ca8c3974dbf8268a981ab8ed2e0/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:04.350619 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.360965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae893b-1fc7-484e-8849-8ac7f4e7a9b2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.416469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.417059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.417333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.417603 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.418221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.419826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed6ff6-c069-4ba0-bf75-a31419f5a016 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.429794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1154/2344] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:04.433861 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.444729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b1680-9c56-4b56-9aaf-47c279b0aae3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.449299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.449949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.450228 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.450500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] PATH_INFO: `/v3/projects/fef3e775177b4a3296aa9d41978ae631/users/d40d3ca8c3974dbf8268a981ab8ed2e0/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.452421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef3e775177b4a3296aa9d41978ae631, user_id=d40d3ca8c3974dbf8268a981ab8ed2e0, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.455050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.465367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1191/2345] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:04 2022] PUT /identity/v3/projects/fef3e775177b4a3296aa9d41978ae631/users/d40d3ca8c3974dbf8268a981ab8ed2e0/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:04.475342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.475797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.475886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.504263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] MFA Rules not processed for user `d40d3ca8c3974dbf8268a981ab8ed2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:04.505380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:04.568954 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:04.573385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1155/2346] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:04.584832 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.586906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:04.597590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:04.643854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0585b-3ae6-48ca-a523-cb1aca626709 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.647470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.648061 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.648331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.648597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.657771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.659169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.668358 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1192/2347] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:04.750141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:04.759913 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bee62-0e0f-4fe9-843f-2309c193a1a6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:04.763576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:04.764962 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:04.765240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:04.765509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:04.820466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:04.821890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd2fb8-414f-4887-b7d0-9e6f5ba689b5 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:04.831296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1156/2348] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:09.488340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:09.549516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099b6728-6ac9-4891-84ef-ff32e10b983b service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:09.553991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:09.554608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:09.554886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:09.555156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] PATH_INFO: `/v3/users/0d5f04595d6e499fa3efa09ffa0e1690` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:09.556286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5f04595d6e499fa3efa09ffa0e1690)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:09.558184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:09.604550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5f04595d6e499fa3efa09ffa0e1690'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:09.616752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5f04595d6e499fa3efa09ffa0e1690'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:09.625231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5f04595d6e499fa3efa09ffa0e1690'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:09.626079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5f04595d6e499fa3efa09ffa0e1690'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:09.638467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5f04595d6e499fa3efa09ffa0e1690'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:09.644286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1193/2349] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:09 2022] DELETE /identity/v3/users/0d5f04595d6e499fa3efa09ffa0e1690 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:09.648776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:09.649251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:09.649887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:09.668195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:09.669390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:09.727442 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1157/2350] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:09.737504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:09.738901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:09.772422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:09.796519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9f371-5ce7-42cb-a09e-ee47c4fd2d8c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:09.800149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:09.800735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:09.801008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:09.801272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:09.809945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:09.811957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:09.821089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1194/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:10.082770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:10.084311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:10.097831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65faf29-1939-4aad-813b-0afd33aacdba None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:10.102597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:10.103809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.104098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.104554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] PATH_INFO: `/v3/projects/382e16532eae455a9ffcad1197a6d169` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.105693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] RBAC: Authorizing `identity:delete_project(project_id=382e16532eae455a9ffcad1197a6d169)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:10.107634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:10.153834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382e16532eae455a9ffcad1197a6d169', 'request_id': 'req-1bf13928-5788-4306-9858-4135ec42483f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.159937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382e16532eae455a9ffcad1197a6d169', 'request_id': 'req-1bf13928-5788-4306-9858-4135ec42483f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.165871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382e16532eae455a9ffcad1197a6d169', 'request_id': 'req-1bf13928-5788-4306-9858-4135ec42483f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.178796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] The token cache is being invalidate because project 382e16532eae455a9ffcad1197a6d169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:10.179088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.179774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.181292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1158/2352] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:10 2022] DELETE /identity/v3/projects/382e16532eae455a9ffcad1197a6d169 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:10.185203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:10.194770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877f37-61e3-4895-b745-7b144e251b27 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:10.249343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:10.249962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.250243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.250573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] PATH_INFO: `/v3/users/d40d3ca8c3974dbf8268a981ab8ed2e0` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.251709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40d3ca8c3974dbf8268a981ab8ed2e0)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:10.253646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:10.298760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40d3ca8c3974dbf8268a981ab8ed2e0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.305671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40d3ca8c3974dbf8268a981ab8ed2e0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.312945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40d3ca8c3974dbf8268a981ab8ed2e0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.313552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40d3ca8c3974dbf8268a981ab8ed2e0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.325265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd568aa8-7ea0-4bc8-8d14-d3fe36fef7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40d3ca8c3974dbf8268a981ab8ed2e0'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.331530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1195/2353] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:10 2022] DELETE /identity/v3/users/d40d3ca8c3974dbf8268a981ab8ed2e0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:10.606365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:10.608377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:10.621287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf13928-5788-4306-9858-4135ec42483f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:10.640403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:10.680187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:10.680822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.681076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.681344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] PATH_INFO: `/v3/projects/fef3e775177b4a3296aa9d41978ae631` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.682440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef3e775177b4a3296aa9d41978ae631)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:10.684410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:10.728725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef3e775177b4a3296aa9d41978ae631', 'request_id': 'req-40ea0ab6-83d9-4c7a-892a-86061442efd1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.734648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef3e775177b4a3296aa9d41978ae631', 'request_id': 'req-40ea0ab6-83d9-4c7a-892a-86061442efd1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.740552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef3e775177b4a3296aa9d41978ae631', 'request_id': 'req-40ea0ab6-83d9-4c7a-892a-86061442efd1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.752055 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] The token cache is being invalidate because project fef3e775177b4a3296aa9d41978ae631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:10.752338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.752943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-40ea0ab6-83d9-4c7a-892a-86061442efd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:10.754384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1159/2354] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:10 2022] DELETE /identity/v3/projects/fef3e775177b4a3296aa9d41978ae631 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:10.759121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.759629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.759732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.778679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:10.780411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:10.825934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:10.840397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1196/2355] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:10.849771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.850058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.850334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.871106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:10.872333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:10.880205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1160/2356] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:10.884502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:10.894306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ba1ff-cf7a-4873-9669-58c1dc0bb5cc None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:10.898881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:10.899502 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.899780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.900071 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.900709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:46:10.901006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:10.902596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:10.914269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1197/2357] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:46:10.973544 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:10.982673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d8fff-77cb-4fc6-bcda-07fab60c83ef None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:10.987830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:10.988413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:10.988686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:10.988953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:10.989588 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:10.991473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.021354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1161/2358] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:11.025633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.037138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578c4e-ec3d-4271-8eae-f2975c008798 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.093999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.094603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.094887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.095155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.095802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.097715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.117262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1198/2359] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:11 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:11.121419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.131676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b417c20-fd48-485d-8b6d-3cbe8113d8db admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.136288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.136874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.137149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.137415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.138043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.140118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.150142 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1162/2360] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:11.153762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.164151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57d53-63a2-4f5c-a7df-f79c715d37cd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.169500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.170032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.170309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.170582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.171212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.172825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121410e7-f0f6-4979-af82-7e81e533b77c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.184119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1199/2361] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:11.188396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.198036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723378f-c3ed-446f-8257-d5670776b43c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.203060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.203722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.203995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.204269 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] PATH_INFO: `/v3/projects/d5a19d0de1d04f21ab5001a864a9c4de/users/1feb98310f394f5fab2033d9d8c4a3f2/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.219425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a19d0de1d04f21ab5001a864a9c4de, user_id=1feb98310f394f5fab2033d9d8c4a3f2, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.222095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.234170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1163/2362] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:11 2022] PUT /identity/v3/projects/d5a19d0de1d04f21ab5001a864a9c4de/users/1feb98310f394f5fab2033d9d8c4a3f2/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:11.244035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.244319 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.244590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.271486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] MFA Rules not processed for user `1feb98310f394f5fab2033d9d8c4a3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:11.272719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:11.335859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1200/2363] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:11.341669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.388449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:11.403870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eb967-81ba-4668-a7a1-366821c16f3d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.409123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.409714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.409988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.410252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.410871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.412765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.438203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1164/2364] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:11 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:11.442298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.453384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c7182-a323-4e76-a800-9dd0518ee6ab None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.495936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:11.508797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.509389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.509662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.509926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.510537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.512486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.533029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1201/2365] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:11 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:11.537098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.547185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126afcb9-79a5-48f7-8493-f387597ee4b9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.551966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.552558 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.552833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.553100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.553752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.555344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.566089 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1165/2366] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:11.569936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.580415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bf602-466a-4cb1-82bf-12dac7efff3f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.585014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.585922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.586196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.586463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] PATH_INFO: `/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1/users/b9187453bef748588df684ad9d71e062/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.601362 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6157e7eb514eb6b78b3c15d4f7efc1, user_id=b9187453bef748588df684ad9d71e062, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.604044 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.616785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1202/2367] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:11 2022] PUT /identity/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1/users/b9187453bef748588df684ad9d71e062/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:11.620661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.631092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e4550-cf3a-4a04-870b-914ed1631e00 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.685034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.685629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.685897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.686671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.687325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.689479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8bb4b-2c11-4dcb-a0a4-7e06b793af8e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.698866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1166/2368] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:46:11.703567 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.713875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babddf-6c3c-4962-8979-0d24f5122565 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.718452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.719088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.719384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.719650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] PATH_INFO: `/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1/users/b9187453bef748588df684ad9d71e062/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.721590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6157e7eb514eb6b78b3c15d4f7efc1, user_id=b9187453bef748588df684ad9d71e062, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.724206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.733871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1203/2369] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:11 2022] PUT /identity/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1/users/b9187453bef748588df684ad9d71e062/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:46:11.743527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.743812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.744085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.771438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] MFA Rules not processed for user `b9187453bef748588df684ad9d71e062`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:11.772634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:11.843556 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1167/2370] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:11.854178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:11.855905 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:11.911964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefae2-347b-437f-82fb-908b010e394d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:11.915744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:11.916372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:11.916650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:11.916915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:11.972313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:11.973650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:11.982248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1204/2371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:16.305163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:16.306553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:16.318162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ac0e-c952-47e8-a35d-0ee2310ba7e7 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:16.321632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:16.322214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:16.322489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:16.322751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:16.331821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:16.333219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4522e6-0561-416b-8b92-a5d2b7a633ac service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:16.343574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1168/2372] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:21.215573 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:21.271342 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:21.278089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4603dc-c813-4508-ad44-4f15d4182e4b service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:21.283360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:21.284037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:21.284313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:21.284583 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] PATH_INFO: `/v3/users/1feb98310f394f5fab2033d9d8c4a3f2` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:21.285702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1feb98310f394f5fab2033d9d8c4a3f2)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:21.287647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:21.333300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1feb98310f394f5fab2033d9d8c4a3f2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.340546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1feb98310f394f5fab2033d9d8c4a3f2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.348293 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1feb98310f394f5fab2033d9d8c4a3f2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.348917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1feb98310f394f5fab2033d9d8c4a3f2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.361108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1feb98310f394f5fab2033d9d8c4a3f2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.366781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1205/2373] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:21 2022] DELETE /identity/v3/users/1feb98310f394f5fab2033d9d8c4a3f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:21.371351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:21.371851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:21.372065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:21.390167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:21.391387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:21.417756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:21.451717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1169/2374] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:21.461493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:21.462887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:21.519601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00923e7-03e6-4332-a52b-428e2e60e54e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:21.523206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:21.523833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:21.524113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:21.524385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:21.533869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:21.535376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:21.544684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1206/2375] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:21.822265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:21.823857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:21.837574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57461259-abf8-408b-9a7c-cdc70edcca39 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:21.843087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:21.843823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:21.844102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:21.844400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] PATH_INFO: `/v3/projects/d5a19d0de1d04f21ab5001a864a9c4de` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:21.845577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a19d0de1d04f21ab5001a864a9c4de)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:21.847529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:21.892521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a19d0de1d04f21ab5001a864a9c4de', 'request_id': 'req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.898095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a19d0de1d04f21ab5001a864a9c4de', 'request_id': 'req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.904245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a19d0de1d04f21ab5001a864a9c4de', 'request_id': 'req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.916518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] The token cache is being invalidate because project d5a19d0de1d04f21ab5001a864a9c4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:21.916833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.917440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:21.918899 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1170/2376] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:21 2022] DELETE /identity/v3/projects/d5a19d0de1d04f21ab5001a864a9c4de => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:21.923091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:21.932594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8feeb-0ce7-4dee-9add-1fe0741c578c service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:21.995026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:21.995599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:21.995872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:21.996426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] PATH_INFO: `/v3/users/b9187453bef748588df684ad9d71e062` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:21.997538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9187453bef748588df684ad9d71e062)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:21.999591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.025308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:22.054374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9187453bef748588df684ad9d71e062'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.061948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9187453bef748588df684ad9d71e062'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.070337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9187453bef748588df684ad9d71e062'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.071045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9187453bef748588df684ad9d71e062'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.083833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-290af79e-322b-471a-a6d6-de5f3f3cf220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9187453bef748588df684ad9d71e062'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.090094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1207/2377] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:46:21 2022] DELETE /identity/v3/users/b9187453bef748588df684ad9d71e062 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:22.363074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.364541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:22.377219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0bb95-45b7-4d91-adb8-f07fef2ffe92 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.435626 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.436263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.436535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.436799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] PATH_INFO: `/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.437890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6157e7eb514eb6b78b3c15d4f7efc1)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.439825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.485843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6157e7eb514eb6b78b3c15d4f7efc1', 'request_id': 'req-c13e9baf-da64-4e65-96f4-503699725743'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.490324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:22.491760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6157e7eb514eb6b78b3c15d4f7efc1', 'request_id': 'req-c13e9baf-da64-4e65-96f4-503699725743'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.498939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6157e7eb514eb6b78b3c15d4f7efc1', 'request_id': 'req-c13e9baf-da64-4e65-96f4-503699725743'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.513144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] The token cache is being invalidate because project bc6157e7eb514eb6b78b3c15d4f7efc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:46:22.513428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.514529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c13e9baf-da64-4e65-96f4-503699725743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:46:22.516047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1171/2378] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:46:22 2022] DELETE /identity/v3/projects/bc6157e7eb514eb6b78b3c15d4f7efc1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:22.523603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.524102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.524203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.544110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:22.545277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:22.610164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1208/2379] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:22.619846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.620128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.620398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.640587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:22.641778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:22.649529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1172/2380] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:22.653789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.664308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f427849-59a5-424e-a2a6-e109d34fe615 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.669054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.669648 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.669923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.670216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.670851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:46:22.671146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.672791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.684013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1209/2381] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:46:22.688636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.697804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c72e2-391d-487a-9d11-dc1c5c3a9d56 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.703050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.703667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.703940 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.704203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.704805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.706684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.732768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1173/2382] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:22.736748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.746433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096301a-18d1-4082-b266-ef791ad30c44 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.800077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.800597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.800870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.801134 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.801741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.803678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.824888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1210/2383] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:22.829366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.840658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a08955-cb9c-453d-97f4-3f8594836d78 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.845352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.845949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.846242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.846495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.847127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.848749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.858495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1174/2384] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:22.862424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.872308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97af0c-174c-4182-aa41-575216dc86c8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.877459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.878046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.878325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.878594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.879226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.880852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122513-fffa-4858-9356-a3249907eb98 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.891811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1211/2385] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:22.895723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:22.905554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf3f14-156c-42c9-b4dd-7e3b3038a35a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:22.910868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:22.911572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.911850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.912125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] PATH_INFO: `/v3/projects/74291027525f431293bb7c09c20dab12/users/1e651cfebd634d5cb2eb6df101c8ac84/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.928693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74291027525f431293bb7c09c20dab12, user_id=1e651cfebd634d5cb2eb6df101c8ac84, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:22.931591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:22.947322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1175/2386] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:22 2022] PUT /identity/v3/projects/74291027525f431293bb7c09c20dab12/users/1e651cfebd634d5cb2eb6df101c8ac84/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:22.953215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eccb0-b214-4fec-89eb-ffe940d5357c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:22.953586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eccb0-b214-4fec-89eb-ffe940d5357c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:22.953922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eccb0-b214-4fec-89eb-ffe940d5357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:22.961682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:22.977054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-028eccb0-b214-4fec-89eb-ffe940d5357c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:22.978398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-028eccb0-b214-4fec-89eb-ffe940d5357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:23.040622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1212/2387] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:46:23.051111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:23.052860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:23.108599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817a3be-cdaa-4e89-9bca-c2b9d44e1123 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:23.112376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:23.113132 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:23.113393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:23.113662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:23.125657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:23.126874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:23.137399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1176/2388] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:46:26.979501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:26.980059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:26.980174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.009631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] MFA Rules not processed for user `1e651cfebd634d5cb2eb6df101c8ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:27.010896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:27.081763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1213/2389] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:27.086514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.096798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f216773-55e4-4920-a294-debc2f251343 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.101293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.101878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.102151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.102416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.103065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.104934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.132579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1177/2390] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:46:27 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:27.136656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.148605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a669162-3514-4850-8c6d-7ddc88952d65 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.234888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.235540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.235814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.236079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.236708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.238617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.265811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1214/2391] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:46:27 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:46:27.270866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.283157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e6b3a-9ebf-49f7-a853-830144bc38fc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.287972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.288583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.288862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.289166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.289981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.295844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.309058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1178/2392] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:27.313931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.324597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160756a-7df7-4878-a1a8-969863353c6f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.329450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.330123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.330403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.330678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] PATH_INFO: `/v3/projects/0b0167c29bc54ed9832570deb5961965/users/ba38e9fd37af46c6ba4f7ab9602eda32/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.347897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0167c29bc54ed9832570deb5961965, user_id=ba38e9fd37af46c6ba4f7ab9602eda32, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.350673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.360359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:27.369884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1215/2393] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:27 2022] PUT /identity/v3/projects/0b0167c29bc54ed9832570deb5961965/users/ba38e9fd37af46c6ba4f7ab9602eda32/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:46:27.370982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.381307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb92490-c893-4040-95ee-499924952ec4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.433122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:27.445676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.446557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.446832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.447101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.447799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.449374 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a51409-e9e5-4a66-b3bf-de5168fd2835 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.460285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1179/2394] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:46:27.464264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:27.475627 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370100a-8b78-40d2-b4e7-d668330fb43b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:27.480333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:27.480998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:27.481275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:27.481549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] PATH_INFO: `/v3/projects/0b0167c29bc54ed9832570deb5961965/users/ba38e9fd37af46c6ba4f7ab9602eda32/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:27.484128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0167c29bc54ed9832570deb5961965, user_id=ba38e9fd37af46c6ba4f7ab9602eda32, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:27.486790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:27.498922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1216/2395] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:46:27 2022] PUT /identity/v3/projects/0b0167c29bc54ed9832570deb5961965/users/ba38e9fd37af46c6ba4f7ab9602eda32/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:46:31.601920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42626e3-e8ad-4b0f-bee1-804fa5e10fd6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:31.603334 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42626e3-e8ad-4b0f-bee1-804fa5e10fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:31.603674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42626e3-e8ad-4b0f-bee1-804fa5e10fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:31.633680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c42626e3-e8ad-4b0f-bee1-804fa5e10fd6 None None] MFA Rules not processed for user `ba38e9fd37af46c6ba4f7ab9602eda32`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:31.635109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c42626e3-e8ad-4b0f-bee1-804fa5e10fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:31.729460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1180/2396] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:31.740949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:46:31.743815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:31.860391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04451f9-4673-46c8-a590-9d96ea7a2d66 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:46:31.866393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:46:31.867045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:31.867306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:31.867585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:31.940237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:46:31.942796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:46:31.957453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1217/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:46:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:46:33.000967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4cb9-f2c4-4f3f-9837-b78ccfb011bc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:46:33.001437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4cb9-f2c4-4f3f-9837-b78ccfb011bc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:46:33.001545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4cb9-f2c4-4f3f-9837-b78ccfb011bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:46:33.020111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-011e4cb9-f2c4-4f3f-9837-b78ccfb011bc None None] MFA Rules not processed for user `1e651cfebd634d5cb2eb6df101c8ac84`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:46:33.021300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-011e4cb9-f2c4-4f3f-9837-b78ccfb011bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:46:33.028095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1181/2398] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:46:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:46:41.947227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:46:43.014881 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=43 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:10.404409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:10.463291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e444349-d4fe-416b-a066-9b0c68f517d3 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:10.468029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:10.468651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:10.468907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:10.469176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:10.470929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:10.484693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:10.486113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:10.496984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1218/2399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:11.596640 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:11.597118 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:11.597211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:11.627642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:11.630527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:11.697302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1182/2400] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:47:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:11.785174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:11.786802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:11.881426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25052c7-c1a5-4298-8932-f61f44467f35 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:11.886716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:11.888265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:11.890040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:11.890327 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:11.899550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:11.901141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:11.915083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1219/2401] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:47:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:16.570361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:16.588186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52df6e-9555-4fc6-af81-8e8f93d0d3d6 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:16.593501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:16.594234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:16.594615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:16.594986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:16.601650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:16.620255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:16.621691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:16.651205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1183/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:17.012557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:17.014700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:17.029155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba982a-d5df-4506-954e-420be75ea340 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:17.034388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:17.035024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:17.035334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:17.035610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:17.046852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:17.048344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb3e13-4c03-43ed-a985-29f0705b41de service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:17.059194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1220/2403] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:26.630973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=35 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:27.054379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=64 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:27.910537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:27.928479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553210f0-323a-4ea6-a547-61fed218cbcd service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:27.932259 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:27.932862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:27.933136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:27.933419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:27.935698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:28.008134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:28.009946 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:28.020905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1184/2404] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:29.531738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:29.532194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:29.532306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:29.584015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:29.585222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:29.608911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1221/2405] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:47:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:29.620836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:29.651342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901944-6ff1-4b96-b1df-cdfe6b263937 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:29.656441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:29.657162 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:29.657447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:29.657719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:29.666339 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:29.668169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:29.677086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1185/2406] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:47:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:31.664013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:31.665580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:31.698916 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3e3f6-ca07-4b95-955b-fc4933a57b0e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:31.705388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:31.723516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:31.724155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:31.724612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] PATH_INFO: `/v3/users/86090cd4247d4d598eb1976f4224b4f3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:31.753899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86090cd4247d4d598eb1976f4224b4f3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:31.756302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:31.841081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86090cd4247d4d598eb1976f4224b4f3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:31.851213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86090cd4247d4d598eb1976f4224b4f3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:31.862668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86090cd4247d4d598eb1976f4224b4f3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:31.863525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86090cd4247d4d598eb1976f4224b4f3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:31.882092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a4b2f30f-4fb1-40d2-a84b-498fb1fcdd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86090cd4247d4d598eb1976f4224b4f3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:31.890204 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1222/2407] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:31 2022] DELETE /identity/v3/users/86090cd4247d4d598eb1976f4224b4f3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:47:32.082071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.094837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057f050-d4d4-40c6-9de0-b733d27bc156 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.154690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.155372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.155652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.155920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] PATH_INFO: `/v3/projects/9193df5e4d39448c947cfbb3139306bf` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.167593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9193df5e4d39448c947cfbb3139306bf)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.170050 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.216111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9193df5e4d39448c947cfbb3139306bf', 'request_id': 'req-65c792df-f86e-41f8-a903-bbcfa989c900'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:32.221654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9193df5e4d39448c947cfbb3139306bf', 'request_id': 'req-65c792df-f86e-41f8-a903-bbcfa989c900'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:32.228472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9193df5e4d39448c947cfbb3139306bf', 'request_id': 'req-65c792df-f86e-41f8-a903-bbcfa989c900'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:32.232049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:32.246930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] The token cache is being invalidate because project 9193df5e4d39448c947cfbb3139306bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:32.247217 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:32.247868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-65c792df-f86e-41f8-a903-bbcfa989c900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:32.249362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1186/2408] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:32 2022] DELETE /identity/v3/projects/9193df5e4d39448c947cfbb3139306bf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:32.254512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.254802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.255078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.276063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:32.277499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:32.345651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1223/2409] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:32.354279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.354682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.354956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.375601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:32.376732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:32.388192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1187/2410] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:32.389521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.400251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e8a69-43a5-464c-bf1b-9b50fce7dff3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.405833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.406593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.406938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.407352 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.408030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:32.408453 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.410206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.426238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1224/2411] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:47:32.427572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.437860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413bbb8-793c-47db-bd49-cba349568dd5 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.442537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.443139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.443441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.443708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.444332 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.446215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.499316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1188/2412] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:32 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:32.500563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.511553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9a130-3c18-4394-becb-aecab3fd8a52 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.523943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:32.598155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.598773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.599050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.599346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.600179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.603205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.643807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1225/2413] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:32 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:32.645094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.656563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21731e65-d949-4d0d-b547-b2998a24d2e5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.661890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.662783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.663464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.663925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.664794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.666635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.684707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.693247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1189/2414] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:32.697644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb333f-78b0-4d4a-a3a4-d89bfb34abaf admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.703880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.704790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.705069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.705373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.707372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.707773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab172d9-6a28-4caf-9358-62fc00cdc8df admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.723292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1226/2415] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:32.724826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.735451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5460-9fdc-46d9-8684-7dfc95e8692a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.740187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.740849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.741129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.741403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] PATH_INFO: `/v3/projects/5e799ebe607d415f86559db6f3a0b11a/users/5e640030f6f04164a14b315a87c906b5/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.757958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e799ebe607d415f86559db6f3a0b11a, user_id=5e640030f6f04164a14b315a87c906b5, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.760726 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:32.777311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1190/2416] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:32 2022] PUT /identity/v3/projects/5e799ebe607d415f86559db6f3a0b11a/users/5e640030f6f04164a14b315a87c906b5/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:32.787697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.788078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.788421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.819565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] MFA Rules not processed for user `5e640030f6f04164a14b315a87c906b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:32.821037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:32.891879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1227/2417] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:32.903141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:32.904994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:32.982276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215040b4-fade-493b-a431-ad6cf7dbf227 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:32.988148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:32.988763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:32.989043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:32.989319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:32.998299 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:32.999926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1d151-29f3-440c-9ed0-b0a6cc169d85 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:33.009354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1191/2418] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:35.792202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:35.876814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909839b-7651-4f40-aaa8-6dec91c105b6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:35.881296 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:35.881946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:35.882223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:35.882498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] PATH_INFO: `/v3/users/5e640030f6f04164a14b315a87c906b5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:35.883846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e640030f6f04164a14b315a87c906b5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:35.886991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:35.913455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:35.943728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e640030f6f04164a14b315a87c906b5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:35.950977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e640030f6f04164a14b315a87c906b5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:35.959600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e640030f6f04164a14b315a87c906b5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:35.960332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e640030f6f04164a14b315a87c906b5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:35.976165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e640030f6f04164a14b315a87c906b5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:35.983028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1228/2419] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:35 2022] DELETE /identity/v3/users/5e640030f6f04164a14b315a87c906b5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:35.987864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:35.988476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:35.988581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.010254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:36.011643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:36.073693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1192/2420] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:47:36.084605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.086628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:36.174259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291a31-b53d-4063-bfda-758d347c39ae admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:36.178101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:36.178726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.179032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.179326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.191155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:36.192802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871c7f7-8fff-43f7-b9a3-40d186205765 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:36.207121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1229/2421] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:36.508994 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.510624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:36.534225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98630f-e6d7-42ee-bbf5-d8f9e9a065da None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:36.539326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:36.539971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.540241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.540512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] PATH_INFO: `/v3/projects/5e799ebe607d415f86559db6f3a0b11a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.541651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e799ebe607d415f86559db6f3a0b11a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:36.544237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:36.546180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:36.606464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e799ebe607d415f86559db6f3a0b11a', 'request_id': 'req-49578e80-bca7-4b34-bc25-fa0dadd2dad1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:36.612194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e799ebe607d415f86559db6f3a0b11a', 'request_id': 'req-49578e80-bca7-4b34-bc25-fa0dadd2dad1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:36.624367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e799ebe607d415f86559db6f3a0b11a', 'request_id': 'req-49578e80-bca7-4b34-bc25-fa0dadd2dad1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:36.638247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] The token cache is being invalidate because project 5e799ebe607d415f86559db6f3a0b11a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:36.638566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:36.639328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-49578e80-bca7-4b34-bc25-fa0dadd2dad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:36.644449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1193/2422] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:36 2022] DELETE /identity/v3/projects/5e799ebe607d415f86559db6f3a0b11a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:36.646190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.646920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.647422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.668741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:36.669953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:36.734483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1230/2423] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:36.742650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.742948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.743205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.764126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:36.765566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:36.773549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1194/2424] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:36.778305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.789647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aac3b-4c16-4bd2-8404-64a85d2e55f1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:36.794865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:36.795636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.795979 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.796431 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.797147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:36.797442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:36.799066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:36.815091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1231/2425] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:36.817965 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.828428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5751-586b-425e-a298-5e129c2c5bbb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:36.834991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:36.835644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.835925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.836200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.837082 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:36.839151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:36.878612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1195/2426] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:36 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:36.883337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.894607 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c267f9-ddaf-4b98-bcd0-82e925b78e24 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:36.919666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:36.956414 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:36.956938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:36.957217 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:36.957493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:36.958109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:36.960068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:36.983164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1232/2427] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:36 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:36.987395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:36.998768 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922966d-54c7-4944-9650-3a36d723ee57 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.003740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.004349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.004629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.010784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.011554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.013976 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.025135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1196/2428] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:37.029131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.039712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236883f8-d1ae-469b-abd1-081ad1bc250d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.044781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.045395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.045675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.045948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.046590 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.048226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b888b-0cda-4453-bce6-2a6c2e250f4d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.060161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1233/2429] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:37.064360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.075326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a3daa-2c63-4e1e-b25c-6d8099b05d3e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.080395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.081128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.081477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.081752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] PATH_INFO: `/v3/projects/899009aa79274bde9d8f08ff93bbdef7/users/aa942efafb724b8eb094e1cd1572d64c/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.098345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899009aa79274bde9d8f08ff93bbdef7, user_id=aa942efafb724b8eb094e1cd1572d64c, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.101404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.117031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1197/2430] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:37 2022] PUT /identity/v3/projects/899009aa79274bde9d8f08ff93bbdef7/users/aa942efafb724b8eb094e1cd1572d64c/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:37.131765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.132048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.132361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.166288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] MFA Rules not processed for user `aa942efafb724b8eb094e1cd1572d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:37.167539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:37.235471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1234/2431] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:37.239918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.304352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16365b1d-890f-41dc-a4fa-dc996b7e04e9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.312801 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.314030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.314030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.314195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.314822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.317070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.351578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1198/2432] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:37 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:37.355363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.370959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081608e4-2714-488a-81ca-d41332aa5766 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.447439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.448064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.448346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.448617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.449876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.451966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.483495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1235/2433] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:37 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:37.488502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.505317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609dd07b-fc25-47b2-a138-e9057af0abaa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.510243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.511120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.511430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.511858 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.512724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.514917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.520612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:37.527182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1199/2434] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:37.531597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.546512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70868d9-3f43-4658-abd6-4ccae192be55 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.551943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.552759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.553033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.553301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] PATH_INFO: `/v3/projects/7a8a79355d4e4c9495e5339d31174a7a/users/eb7dc23d0de9438ca2404e1cef2c844d/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.570198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8a79355d4e4c9495e5339d31174a7a, user_id=eb7dc23d0de9438ca2404e1cef2c844d, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.572992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.588046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:37.594290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1236/2435] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:37 2022] PUT /identity/v3/projects/7a8a79355d4e4c9495e5339d31174a7a/users/eb7dc23d0de9438ca2404e1cef2c844d/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:37.598113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.612823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a3a7-bd55-4391-9f9a-ae90fd9482f0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.672325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.673043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.673384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.673721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.674455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.676152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b014dd1-5d52-40f7-ac84-7cc8c2edd0f4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.686829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1200/2436] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:37.690892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.702090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3f21-4b33-45ab-8261-3eced2395e78 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.707024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.707732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.708011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.708316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] PATH_INFO: `/v3/projects/7a8a79355d4e4c9495e5339d31174a7a/users/eb7dc23d0de9438ca2404e1cef2c844d/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.710195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8a79355d4e4c9495e5339d31174a7a, user_id=eb7dc23d0de9438ca2404e1cef2c844d, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.713118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.724978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1237/2437] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:37 2022] PUT /identity/v3/projects/7a8a79355d4e4c9495e5339d31174a7a/users/eb7dc23d0de9438ca2404e1cef2c844d/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:37.735706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.736134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.736301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.767059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] MFA Rules not processed for user `eb7dc23d0de9438ca2404e1cef2c844d`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:37.768286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:37.838366 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1201/2438] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:37.851227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:37.853650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:37.919553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6a37e-b5d8-450c-a3a4-bd22f8edeabc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:37.924798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:37.925412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:37.925686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:37.925950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:37.937525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:37.938977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:37.959441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1238/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:47:38.006421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:38.008115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:38.020788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df9df2-996f-4489-93fe-f541a2af68dc None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:38.025068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:38.025688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:38.025970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:38.026244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:38.087605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:38.089066 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4b641-8653-4900-9a36-3498823738b7 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:38.098462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1202/2440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:41.443948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:41.505197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6a4f-4174-4042-a615-45f54a824fad service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:41.509732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:41.510343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:41.510619 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:41.510887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] PATH_INFO: `/v3/users/aa942efafb724b8eb094e1cd1572d64c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:41.512609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa942efafb724b8eb094e1cd1572d64c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:41.514521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:41.557874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa942efafb724b8eb094e1cd1572d64c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:41.565471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa942efafb724b8eb094e1cd1572d64c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:41.572325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa942efafb724b8eb094e1cd1572d64c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:41.573110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa942efafb724b8eb094e1cd1572d64c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:41.586555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa942efafb724b8eb094e1cd1572d64c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:41.592862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1239/2441] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:41 2022] DELETE /identity/v3/users/aa942efafb724b8eb094e1cd1572d64c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:41.602826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:41.603466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:41.603746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:41.622745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:41.623967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:41.637380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:41.681660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1203/2442] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:41.691775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:41.693161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:41.704697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:41.752624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b3e6d-27a4-4dee-90b4-a50755c13ca6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:41.756288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:41.756896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:41.757170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:41.757438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:41.767017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:41.768520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:41.777834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1240/2443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:47:42.050489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:42.052030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:42.064294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6992da-4171-4cfb-b4e8-31ce12fa8a4d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:42.069221 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:42.069850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.070128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.070400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] PATH_INFO: `/v3/projects/899009aa79274bde9d8f08ff93bbdef7` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.071589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899009aa79274bde9d8f08ff93bbdef7)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:42.073586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:42.120361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899009aa79274bde9d8f08ff93bbdef7', 'request_id': 'req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.127037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899009aa79274bde9d8f08ff93bbdef7', 'request_id': 'req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.133748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899009aa79274bde9d8f08ff93bbdef7', 'request_id': 'req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.147840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] The token cache is being invalidate because project 899009aa79274bde9d8f08ff93bbdef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:42.148251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.148966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.150547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1204/2444] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:42 2022] DELETE /identity/v3/projects/899009aa79274bde9d8f08ff93bbdef7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:42.155067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:42.169049 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598ed50-86d4-48e1-9aec-f4ad028c907e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:42.253009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:42.253902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.254411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.254941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] PATH_INFO: `/v3/users/eb7dc23d0de9438ca2404e1cef2c844d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.256598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7dc23d0de9438ca2404e1cef2c844d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:42.258783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:42.307608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7dc23d0de9438ca2404e1cef2c844d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.314925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7dc23d0de9438ca2404e1cef2c844d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.322206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7dc23d0de9438ca2404e1cef2c844d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.322809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7dc23d0de9438ca2404e1cef2c844d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.335644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-01580b3f-f1fc-4811-b6ca-d8e1e1fd1d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7dc23d0de9438ca2404e1cef2c844d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.341923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1241/2445] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:42 2022] DELETE /identity/v3/users/eb7dc23d0de9438ca2404e1cef2c844d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:42.632152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:42.633661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:42.648596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2dd8-a0f0-48ab-b3bd-644065e3cf12 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:42.706828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:42.707417 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.707695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.707987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] PATH_INFO: `/v3/projects/7a8a79355d4e4c9495e5339d31174a7a` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.709095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8a79355d4e4c9495e5339d31174a7a)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:42.711095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:42.755548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:42.758706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8a79355d4e4c9495e5339d31174a7a', 'request_id': 'req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.765472 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8a79355d4e4c9495e5339d31174a7a', 'request_id': 'req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.771460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8a79355d4e4c9495e5339d31174a7a', 'request_id': 'req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.783402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] The token cache is being invalidate because project 7a8a79355d4e4c9495e5339d31174a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:42.783806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.784428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-1cb36bd1-a6c7-4d25-bae0-41b5659b0d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:42.785883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1205/2446] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:42 2022] DELETE /identity/v3/projects/7a8a79355d4e4c9495e5339d31174a7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:42.791137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.791649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.791760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.811786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:42.812973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:42.838166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:42.873200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1242/2447] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:42.881013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.881298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.881568 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.901068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:42.902791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:42.915169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1206/2448] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:42.920876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:42.931258 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17dc1e-60a2-4e17-9403-ef279b52556d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:42.937067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:42.937673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.938364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.938640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.939321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:42.939625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:42.941216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:42.952934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1243/2449] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:42.957399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:42.967177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3e590-b649-432b-acaa-652b6e66dc0d None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:42.971805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:42.972387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:42.972664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:42.972932 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:42.973554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:42.975451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.001887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1207/2450] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:42 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:43.006068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.015890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d3cc-b61a-414a-8e66-e8c718609184 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.070408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.071001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.071305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.071577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.072197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.074106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.095151 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1244/2451] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:43 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:43.099223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.110080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d635c-e8e0-4b5d-a153-d86c69201321 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.114709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.115318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.115599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.115869 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.116498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.118056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.128718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1208/2452] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:43.132617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.142531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc21ab-847b-4b34-b962-ad543ab83aa5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.148936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.149539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.149821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.150273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.150925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.153710 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34553cc0-fbad-4bcf-9393-6e66455f1ecb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.165403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1245/2453] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:43.170112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.180749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319daa53-9c44-43e7-8677-56cb22381785 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.185632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.186285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.186559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.186828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] PATH_INFO: `/v3/projects/801590c3ec0b41468e27724ea816cc1d/users/4f2ab816976942db94ffa76f3ba43687/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.201493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801590c3ec0b41468e27724ea816cc1d, user_id=4f2ab816976942db94ffa76f3ba43687, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.204157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.217483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1209/2454] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:43 2022] PUT /identity/v3/projects/801590c3ec0b41468e27724ea816cc1d/users/4f2ab816976942db94ffa76f3ba43687/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:47:43.228962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.229243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.229514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.257181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] MFA Rules not processed for user `4f2ab816976942db94ffa76f3ba43687`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:43.258374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:43.323493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1246/2455] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:43.328285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.399220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80239b69-6f7a-49ab-8ad9-65ee27056f18 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.404811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.405536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.405850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.406220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.406996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.408995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.439173 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1210/2456] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:43 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:43.440436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.452212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34df5a6-5e1f-4e57-b03d-9bc87dd1cbfc None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.477569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:43.509396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.510032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.510310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.510578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.511189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.513621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.535482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1247/2457] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:43 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:43.539474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.549657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a86ce6-62dc-4511-ab5f-720fe0ef6383 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.554230 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.554812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.555086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.555381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.556008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.557604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.567705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1211/2458] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:43.571636 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.582040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307345f5-6688-4bbc-b071-fbb324c97ef7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.587022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.587692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.587969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.588236 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] PATH_INFO: `/v3/projects/24c67e4361de4ded9cb5807c4d1b622e/users/a3336d44e30f414f87960815dc5cf474/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.604069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c67e4361de4ded9cb5807c4d1b622e, user_id=a3336d44e30f414f87960815dc5cf474, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.606803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.619341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1248/2459] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:43 2022] PUT /identity/v3/projects/24c67e4361de4ded9cb5807c4d1b622e/users/a3336d44e30f414f87960815dc5cf474/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:43.623404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.633192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d37e1-4042-4648-af68-9a654fbd666d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.674160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:43.691081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.691887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.692185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.692453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.693083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.694659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f24a65-c0d3-422e-81e5-c782cedaed62 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.704765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1212/2460] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:43.709000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.719403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86989e58-bfab-4e32-a1f6-3c7a548f5a3b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.723960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.724592 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.724927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.725191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] PATH_INFO: `/v3/projects/24c67e4361de4ded9cb5807c4d1b622e/users/a3336d44e30f414f87960815dc5cf474/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.727048 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c67e4361de4ded9cb5807c4d1b622e, user_id=a3336d44e30f414f87960815dc5cf474, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.729771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.739977 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1249/2461] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:43 2022] PUT /identity/v3/projects/24c67e4361de4ded9cb5807c4d1b622e/users/a3336d44e30f414f87960815dc5cf474/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:47:43.750260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.750615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.750950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.777925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] MFA Rules not processed for user `a3336d44e30f414f87960815dc5cf474`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:43.779115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:43.844973 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1213/2462] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:43.856919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:43.858601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:43.913923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc631c1-437b-4de0-8a10-b8677fde7697 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:43.917503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:43.918662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:43.918939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:43.919200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:43.928595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:43.930196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:43.940348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1250/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:47:44.015972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.025466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d06f-2f29-479d-a083-1cfb35836cfb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.029996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.030592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.030871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.031141 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.085127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.086803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7344a50-d9c3-4247-b82e-f9715baa6e81 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.096482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1214/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:44.355094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.417366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ba145-34b4-431a-8141-9deb21d5865d service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.421942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.422564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.422841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.423110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] PATH_INFO: `/v3/users/4f2ab816976942db94ffa76f3ba43687` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.424243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2ab816976942db94ffa76f3ba43687)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.426155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.448395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.473731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2ab816976942db94ffa76f3ba43687'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:44.481507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2ab816976942db94ffa76f3ba43687'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:44.488987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2ab816976942db94ffa76f3ba43687'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:44.489719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2ab816976942db94ffa76f3ba43687'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:44.502459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2ab816976942db94ffa76f3ba43687'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:44.508575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1251/2465] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:44 2022] DELETE /identity/v3/users/4f2ab816976942db94ffa76f3ba43687 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:44.513938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.514286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.514578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.533896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:44.535022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.594761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1215/2466] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:44.604680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.606166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.664872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4680-ba5d-4b2f-a819-5e5197d4d231 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.668562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.669162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.669441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.669724 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.678561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.680001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:44.689794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1252/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:44.946914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:44.948395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:44.956717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:44.965687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a89c7-9895-4cc8-a32f-d78998ab4fcb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:44.970516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:44.971140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:44.971447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:44.971804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] PATH_INFO: `/v3/projects/801590c3ec0b41468e27724ea816cc1d` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:44.972825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801590c3ec0b41468e27724ea816cc1d)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:44.974716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.021643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801590c3ec0b41468e27724ea816cc1d', 'request_id': 'req-555759c0-b1cc-4570-ad07-ad48b427e036'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.027016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801590c3ec0b41468e27724ea816cc1d', 'request_id': 'req-555759c0-b1cc-4570-ad07-ad48b427e036'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.033182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801590c3ec0b41468e27724ea816cc1d', 'request_id': 'req-555759c0-b1cc-4570-ad07-ad48b427e036'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.045168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] The token cache is being invalidate because project 801590c3ec0b41468e27724ea816cc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:45.045465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.046054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.047559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1216/2468] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:44 2022] DELETE /identity/v3/projects/801590c3ec0b41468e27724ea816cc1d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:45.051442 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.061685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7f3c-6a87-44e2-bd73-355a0c0da69f service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.117196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.117747 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.118024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.118295 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] PATH_INFO: `/v3/users/a3336d44e30f414f87960815dc5cf474` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.119428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3336d44e30f414f87960815dc5cf474)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.121944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.164349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:45.166121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3336d44e30f414f87960815dc5cf474'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.174843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3336d44e30f414f87960815dc5cf474'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.182256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3336d44e30f414f87960815dc5cf474'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.182917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3336d44e30f414f87960815dc5cf474'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.196515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db8695f6-d0ef-4aa7-b72e-2506ee9869fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3336d44e30f414f87960815dc5cf474'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.205054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1253/2469] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:45 2022] DELETE /identity/v3/users/a3336d44e30f414f87960815dc5cf474 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:45.473803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.475258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:45.489115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555759c0-b1cc-4570-ad07-ad48b427e036 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.554531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.555171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.555483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.555757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] PATH_INFO: `/v3/projects/24c67e4361de4ded9cb5807c4d1b622e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.556880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c67e4361de4ded9cb5807c4d1b622e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.559421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.612680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c67e4361de4ded9cb5807c4d1b622e', 'request_id': 'req-d6e0de24-e975-459b-a50a-f573e0c77ac7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.618280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c67e4361de4ded9cb5807c4d1b622e', 'request_id': 'req-d6e0de24-e975-459b-a50a-f573e0c77ac7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.625595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c67e4361de4ded9cb5807c4d1b622e', 'request_id': 'req-d6e0de24-e975-459b-a50a-f573e0c77ac7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.638778 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] The token cache is being invalidate because project 24c67e4361de4ded9cb5807c4d1b622e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:45.639046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.639639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d6e0de24-e975-459b-a50a-f573e0c77ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:45.641138 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1217/2470] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:45 2022] DELETE /identity/v3/projects/24c67e4361de4ded9cb5807c4d1b622e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:45.646028 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.646317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.646685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.668794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:45.669990 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:45.732203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1254/2471] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:45.743265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.744406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.744687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.765548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:45.766798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:45.774642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1218/2472] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:45.778997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.788718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73455d5-a1bf-4224-8968-4e0609c66129 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.793817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.794416 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.794692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.794959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.795631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:45.795930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.797532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.809940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1255/2473] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:45.814026 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.823351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fba6a-e05e-40e7-9e28-8f28c7bcedc9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.827990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.828576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.828849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.829114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.829724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.831611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.842116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:45.867569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1219/2474] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:45 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:45.869455 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.881347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd2622-a905-4eac-b0f0-59bc7a20d689 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.944956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.945588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.945935 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.946272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.946995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.949023 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:45.974059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1256/2475] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:45 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:45.975513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:45.985782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748561f-7114-4b03-917e-8b7337b66f6a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:45.990658 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:45.991263 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:45.991553 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:45.991818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:45.992455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:45.994034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.004936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1220/2476] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:46.009020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:46.020211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e64649-d230-4816-83fd-1817af6c69a9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:46.024912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:46.025508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.025788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.026055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.026691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:46.028336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5442-d3a3-4224-b616-ec1acb5d0344 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.039509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1257/2477] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:46.043857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:46.054040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25f4f7-e83c-470c-b9d4-fb7459353238 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:46.059145 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:46.059812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.060085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.060350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] PATH_INFO: `/v3/projects/f424542d03c54bc5ae5f08567453078e/users/96458712694344b78bba81615650927b/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.074604 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f424542d03c54bc5ae5f08567453078e, user_id=96458712694344b78bba81615650927b, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:46.077249 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.090740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1221/2478] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:46 2022] PUT /identity/v3/projects/f424542d03c54bc5ae5f08567453078e/users/96458712694344b78bba81615650927b/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:46.101113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.101481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.101585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.128613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] MFA Rules not processed for user `96458712694344b78bba81615650927b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:46.129818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:46.146428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:46.194395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1258/2479] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:46.205925 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:46.207627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:46.263398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb06d8-97fd-4012-866e-ab6d1ebd6fb4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:46.266950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:46.267584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.267861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.268129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.276125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:46.278251 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2b12b-6c1d-43e7-957c-3e57acc6aa61 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.288043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1222/2480] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:46.309373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:46.370355 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a63a64-aa7f-4c91-a855-0c39537a89de None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:46.375365 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:46.375978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.376253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.376521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] PATH_INFO: `/v3/users/96458712694344b78bba81615650927b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.377625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96458712694344b78bba81615650927b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:46.379537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.432464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96458712694344b78bba81615650927b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:46.441312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96458712694344b78bba81615650927b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:46.450393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96458712694344b78bba81615650927b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:46.451009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96458712694344b78bba81615650927b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:46.469433 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96458712694344b78bba81615650927b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:46.481107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1259/2481] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:47:46 2022] DELETE /identity/v3/users/96458712694344b78bba81615650927b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:46.483810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.484227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.484566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.507479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:46.508756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:46.585947 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1223/2482] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:46.599280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:46.599280 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:46.641611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:46.659281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ebcd-c734-4357-8581-098fa1b9e539 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:46.662857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:46.663488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:46.663765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:46.664030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:46.673755 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:46.675164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7edc-b576-410f-9c9d-c935069d6e22 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:46.684975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1260/2483] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:47.054379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.054379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:47.061077 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d42974-f404-4b2e-a2da-477f628c6f79 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.065818 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.066468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.066743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.067012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] PATH_INFO: `/v3/projects/f424542d03c54bc5ae5f08567453078e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.068140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f424542d03c54bc5ae5f08567453078e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.070547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.115144 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f424542d03c54bc5ae5f08567453078e', 'request_id': 'req-9ca19f76-8538-4f91-9d6b-af9f660587a5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:47.117095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:47.122378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f424542d03c54bc5ae5f08567453078e', 'request_id': 'req-9ca19f76-8538-4f91-9d6b-af9f660587a5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:47.129608 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f424542d03c54bc5ae5f08567453078e', 'request_id': 'req-9ca19f76-8538-4f91-9d6b-af9f660587a5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:47.141120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] The token cache is being invalidate because project f424542d03c54bc5ae5f08567453078e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:47:47.141400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:47.142086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-9ca19f76-8538-4f91-9d6b-af9f660587a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:47:47.143682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1224/2484] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:47:47 2022] DELETE /identity/v3/projects/f424542d03c54bc5ae5f08567453078e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:47.148552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.149006 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.149136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.168536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:47.169739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:47.233165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1261/2485] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:47.240817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.241105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.241379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.261081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:47.262303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:47.270365 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1225/2486] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:47:47.274341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.284183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37adfd0-8580-4a64-9ec9-f3e184feb4bb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.288742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.289364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.289643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.289911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.290548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:47:47.290845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.292454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.304131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1262/2487] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:47:47.308281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.318014 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd30e8-995b-48db-ad58-3b87862d5edb None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.322665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.323272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.323564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.323830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.324725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.326699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.353609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1226/2488] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:47:47 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:47:47.358241 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.368193 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73b8ef-4950-4732-bc49-94db88b39c6f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.428943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.429549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.429834 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.430099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.430733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.432675 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.453628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1263/2489] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:47:47 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:47:47.457537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.468592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0728ca-4f96-49f8-92d4-200f764eeadf admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.473168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.473757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.474033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.474326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.474986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.476612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.486963 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1227/2490] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:47.490822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.501014 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49ebb7-634a-4138-b147-f830efce2037 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.505602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.506187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.506466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.506736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.507399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.508964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e6da0-ff27-43f9-8765-6b9369cef6b9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.519825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1264/2491] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:47:47.523870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.534455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75c1c5-3784-43b7-89a7-530934db7119 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.539020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.539694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.539966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.540229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] PATH_INFO: `/v3/projects/e3959e559ae642e88844b20c26cc39d5/users/2b066fface374ff0bc373f7a06a7233a/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.557045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3959e559ae642e88844b20c26cc39d5, user_id=2b066fface374ff0bc373f7a06a7233a, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.559800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.573272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1228/2492] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:47:47 2022] PUT /identity/v3/projects/e3959e559ae642e88844b20c26cc39d5/users/2b066fface374ff0bc373f7a06a7233a/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:47:47.578312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efa2-ebf4-4caf-b9b4-d142a6d5c877 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.578593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efa2-ebf4-4caf-b9b4-d142a6d5c877 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.578863 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702efa2-ebf4-4caf-b9b4-d142a6d5c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.598452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4702efa2-ebf4-4caf-b9b4-d142a6d5c877 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:47.600514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4702efa2-ebf4-4caf-b9b4-d142a6d5c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:47.649496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:47.669598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1265/2493] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:47.679235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:47.681058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:47.745456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721362d2-3ae7-4c71-95b4-9591531e4e34 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:47.749002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:47.749609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:47.749884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:47.750151 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:47.758920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:47.760380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:47.770204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1229/2494] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:48.491680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e9b-ff65-4836-8d63-a71fb4151ccd None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:48.492211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e9b-ff65-4836-8d63-a71fb4151ccd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:48.492312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e9b-ff65-4836-8d63-a71fb4151ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:48.522260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5d476e9b-ff65-4836-8d63-a71fb4151ccd None None] MFA Rules not processed for user `2b066fface374ff0bc373f7a06a7233a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:48.523346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5d476e9b-ff65-4836-8d63-a71fb4151ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:48.613460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1266/2495] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:48.623081 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:48.624600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:48.688181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6df8d-4c53-4b35-99a9-518e3e9fcb1e service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:48.691764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:48.692364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:48.692639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:48.693240 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:48.701426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:48.702829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd745f-8944-4b72-9553-d8f1b2dce9d8 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:48.711712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1230/2496] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:50.057329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:50.057852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:50.057852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:50.076506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] MFA Rules not processed for user `2b066fface374ff0bc373f7a06a7233a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:50.077671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:50.084330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1267/2497] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:47:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:51.757312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.758229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.758727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.778406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:47:51.779683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:51.799769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:47:51.850256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1231/2498] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:47:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:47:51.862306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:51.863907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:51.960928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a6305-5a00-40fd-b608-11d95c2be96a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:51.966886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:51.967623 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:51.967902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:51.968170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:51.977546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:51.979140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:51.997326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1268/2499] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:47:54.024846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:54.034877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1860db-5bd9-4136-81c9-141ca8285442 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:54.039278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:54.039886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:54.040345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:54.040621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:54.042533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:54.052586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:54.054008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:54.062289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1232/2500] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:47:57.885931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:47:57.887384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:57.899109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c8f1-bc79-4204-b7c0-945298ae01f5 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:47:57.903164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:47:57.903787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:47:57.904065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:47:57.904334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:47:57.905963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:47:57.919233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:47:57.920729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:47:57.930638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1269/2501] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:00.129906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:00.132040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:00.215522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c9d9-2fb5-47e3-a3b7-27c440b838ed service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:00.221392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:00.222096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:00.222372 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:00.222641 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:00.224398 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:00.237245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:00.238815 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:00.249782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1233/2502] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:01.336644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:01.338079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:01.350531 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9e1a3-c841-4124-baef-a39d809a34f1 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:01.356036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:01.356661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.356938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.357206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] PATH_INFO: `/v3/users/28a58d55f9cc42c7a041884eee0ea248` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.371649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a58d55f9cc42c7a041884eee0ea248)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:01.373575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:01.393220 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:01.419985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a58d55f9cc42c7a041884eee0ea248'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.426885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a58d55f9cc42c7a041884eee0ea248'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.434643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a58d55f9cc42c7a041884eee0ea248'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.435269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a58d55f9cc42c7a041884eee0ea248'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.447153 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-69e3ae19-ee34-47e9-b941-647176d55147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a58d55f9cc42c7a041884eee0ea248'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.453435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1270/2503] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:01 2022] DELETE /identity/v3/users/28a58d55f9cc42c7a041884eee0ea248 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:01.629124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:01.641277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d703d6-d7d8-4611-b4f1-a859ddb99983 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:01.704803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:01.705430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.705702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.705969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] PATH_INFO: `/v3/projects/2a036d3083bb4055a3aed77a698b2c3b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.720367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a036d3083bb4055a3aed77a698b2c3b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:01.722484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:01.767009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:01.780990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a036d3083bb4055a3aed77a698b2c3b', 'request_id': 'req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.786429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a036d3083bb4055a3aed77a698b2c3b', 'request_id': 'req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.793482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a036d3083bb4055a3aed77a698b2c3b', 'request_id': 'req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.806411 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] The token cache is being invalidate because project 2a036d3083bb4055a3aed77a698b2c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:01.806738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.807473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-326d6f13-3d0e-4268-8d70-7c90a1b86f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:01.809723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1234/2504] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:01 2022] DELETE /identity/v3/projects/2a036d3083bb4055a3aed77a698b2c3b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:01.814770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.814992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.815306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.835470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:01.837119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:01.896268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1271/2505] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:01.904009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.904293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.904562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.923476 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:01.924652 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:01.932327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1235/2506] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:01.936886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:01.946267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacea4b-e790-4dba-b75b-df5c8cf3179a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:01.951495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:01.952081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.952356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.952624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.953255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:01.953551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:01.955124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:01.966893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1272/2507] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:01.970930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:01.980293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a94a2-a470-4330-bcfa-97d65e5185ce None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:01.985068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:01.985660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:01.985935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:01.986204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:01.986827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:01.988758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.019528 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1236/2508] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:01 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:02.023910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.035015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6886-37ad-41d3-9d39-7ccd6a407a80 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.091201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.091839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.092121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.092396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.093012 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.094908 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.115925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1273/2509] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:02 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:02.120926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.130930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15ab1-60f3-4da3-a4ca-a66220a0e327 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.135462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.136064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.136345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.136599 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.137223 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.138782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.148268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1237/2510] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:02.152045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.161836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc64419-5ec6-4c3c-a3c7-0ccf599b9d18 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.166520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.167641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.168259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.168259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.168902 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.170477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391e20-fb36-4cbe-b050-6743ef864efc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.180912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1274/2511] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:02.185597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.196353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076662f3-6746-4b8d-80e7-7c5639f34fd7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.201043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.201706 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.201977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.202245 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] PATH_INFO: `/v3/projects/33e71f1aa46e4f4fbc5f6774d95322ac/users/15f03a49687745cdaba51d5b324138a4/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.216977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e71f1aa46e4f4fbc5f6774d95322ac, user_id=15f03a49687745cdaba51d5b324138a4, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.219669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.232383 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1238/2512] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:02 2022] PUT /identity/v3/projects/33e71f1aa46e4f4fbc5f6774d95322ac/users/15f03a49687745cdaba51d5b324138a4/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:02.243602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.243896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.244205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.251332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:02.274428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] MFA Rules not processed for user `15f03a49687745cdaba51d5b324138a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:02.275604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:02.338191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1275/2513] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:02.350326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.352293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:02.427580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46099-06ff-4f76-8739-f1f23bedb6cb admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.433091 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.433749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.434040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.434310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.442120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.443745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1856ea9-0be3-4c9c-8efb-1aa46a1199b4 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.452629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1239/2514] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:02.661074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.724673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b9c1c-e472-42dc-aa78-6fac11d7b1a5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.729230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.730405 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.730681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.730951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] PATH_INFO: `/v3/users/15f03a49687745cdaba51d5b324138a4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.732094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f03a49687745cdaba51d5b324138a4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:02.734013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:02.781465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f03a49687745cdaba51d5b324138a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:02.788443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f03a49687745cdaba51d5b324138a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:02.796941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f03a49687745cdaba51d5b324138a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:02.797576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f03a49687745cdaba51d5b324138a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:02.810274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f03a49687745cdaba51d5b324138a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:02.816288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1276/2515] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:02 2022] DELETE /identity/v3/users/15f03a49687745cdaba51d5b324138a4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:02.820868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.821381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.821466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.841790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:02.842996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:02.881582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:02.904896 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1240/2516] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:02.915011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:02.916823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:02.931720 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:02.983857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf29bb-65ea-42b5-8aaa-ca35738b1e03 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:02.987557 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:02.988173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:02.988446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:02.988719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:02.998595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.000065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a348-db3e-48a6-9dd6-66c11b33a777 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.010347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1277/2517] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:03.282906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.284487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:03.298673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3454b-40ec-4124-a205-95be50ab4287 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.304229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.305013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.305292 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.305565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] PATH_INFO: `/v3/projects/33e71f1aa46e4f4fbc5f6774d95322ac` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.306845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e71f1aa46e4f4fbc5f6774d95322ac)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.309073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.360149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e71f1aa46e4f4fbc5f6774d95322ac', 'request_id': 'req-fccf5d71-9380-414a-8a7d-7afb034693f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:03.365545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e71f1aa46e4f4fbc5f6774d95322ac', 'request_id': 'req-fccf5d71-9380-414a-8a7d-7afb034693f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:03.372253 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e71f1aa46e4f4fbc5f6774d95322ac', 'request_id': 'req-fccf5d71-9380-414a-8a7d-7afb034693f7'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:03.383834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] The token cache is being invalidate because project 33e71f1aa46e4f4fbc5f6774d95322ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:03.384115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:03.384721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-fccf5d71-9380-414a-8a7d-7afb034693f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:03.386222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1241/2518] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:03 2022] DELETE /identity/v3/projects/33e71f1aa46e4f4fbc5f6774d95322ac => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:03.391083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.391611 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.391789 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.413678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:03.414886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:03.476570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1278/2519] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:03.484535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.484829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.485105 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.505386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:03.506657 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:03.515125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1242/2520] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:03.519413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.529019 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f37fa4-a8da-46f8-a97d-f90a33500692 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.533692 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.534284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.534559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.534830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.535506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:03.535803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.537378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.549161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1279/2521] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:03.553420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.562991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b73a1-2277-422b-a5a0-284ad128a669 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.567631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.568210 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.568484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.568748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.569359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.571237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.599002 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1243/2522] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:03 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:03.603330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.614164 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047161e2-65c5-4bb4-92a9-e7e0586fc26b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.673501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.674201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.674397 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.674662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.675335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.677245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.701010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1280/2523] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:03 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:03.704877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.716443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc37988-055d-44e6-942f-33bf893e82f5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.721406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.722000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.722276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.722545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.723176 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.724785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.735579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1244/2524] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:03.739778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.750926 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f22b7-d5a2-4ea8-9f3d-4f4aac4064ba admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.755589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.756183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.756458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.756728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.757547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.759117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d231edb-39bb-4df1-9aec-69aeec82f7e6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.770039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1281/2525] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:03.774280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.787031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373c2b2-f7fb-4f33-8493-05d27963bfb1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:03.792659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:03.793310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.793591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.793922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] PATH_INFO: `/v3/projects/be5f2ad4b99c4d8a87ddffc485ab5b8c/users/971f287b39ba4bd3984e05f7cddc4cba/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.810379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5f2ad4b99c4d8a87ddffc485ab5b8c, user_id=971f287b39ba4bd3984e05f7cddc4cba, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:03.813733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:03.828054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1245/2526] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:03 2022] PUT /identity/v3/projects/be5f2ad4b99c4d8a87ddffc485ab5b8c/users/971f287b39ba4bd3984e05f7cddc4cba/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:03.832973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747854f-0d33-4683-a0b4-43c27a53f71e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:03.833562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747854f-0d33-4683-a0b4-43c27a53f71e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:03.833562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747854f-0d33-4683-a0b4-43c27a53f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:03.852686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d747854f-0d33-4683-a0b4-43c27a53f71e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:03.853885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d747854f-0d33-4683-a0b4-43c27a53f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:03.867600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:03.916055 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1282/2527] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:03.926522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:03.928357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:04.001843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7be60-6518-4dcc-a38b-59918fc31929 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:04.005481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:04.006083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.006362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.006631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.015700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:04.017107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:04.026875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1246/2528] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:04.636313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.636793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.636890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.664988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] MFA Rules not processed for user `971f287b39ba4bd3984e05f7cddc4cba`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:04.666184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:04.733421 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1283/2529] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:04.740391 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:04.749234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:04.753522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dfe3-eab2-45b7-87f8-932ab49738e4 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:04.760166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:04.761494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.761877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.762306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.762936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:04.764917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:04.791856 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1247/2530] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:04 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:04.796251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:04.807993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa9bc-5be6-432e-b241-140b074583cb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:04.864983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:04.865586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.865881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.866146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.866786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:04.868734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:04.889993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1284/2531] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:04 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:04.893975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:04.904309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deff8cc-2b1e-40f7-a183-db787cbe794f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:04.908901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:04.909489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.909763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.910036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.910664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:04.912289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:04.922854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1248/2532] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:04.926640 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:04.936785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c5f3e-4aa0-4926-a282-1bfeefc7573f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:04.941250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:04.941877 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:04.942154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:04.942424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] PATH_INFO: `/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a/users/127fe99acf9946a69c87ddf759d163ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:04.958377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ffa2aca674a83b0c8be49cfe1e22a, user_id=127fe99acf9946a69c87ddf759d163ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:04.961039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:04.975359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1285/2533] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:04 2022] PUT /identity/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a/users/127fe99acf9946a69c87ddf759d163ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:04.979435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:04.989243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3d30c-94bf-4fca-a456-9378bc5c559e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:05.046164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:05.046769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:05.047049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:05.047348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:05.047985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:05.049571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1469d6-43ca-4d85-85b3-4ea879b223df admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:05.060178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1249/2534] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:05.064314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:05.074685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9a895-db10-4351-b7a7-df0b6fb1418c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:05.079487 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:05.080146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:05.080424 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:05.080697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] PATH_INFO: `/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a/users/127fe99acf9946a69c87ddf759d163ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:05.083678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74ffa2aca674a83b0c8be49cfe1e22a, user_id=127fe99acf9946a69c87ddf759d163ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:05.089102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:05.101572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1286/2535] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:05 2022] PUT /identity/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a/users/127fe99acf9946a69c87ddf759d163ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:05.867539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a855-9910-4c6d-9a8b-eb67bd9dea80 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:05.868022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a855-9910-4c6d-9a8b-eb67bd9dea80 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:05.868385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a855-9910-4c6d-9a8b-eb67bd9dea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:05.897636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-0387a855-9910-4c6d-9a8b-eb67bd9dea80 None None] MFA Rules not processed for user `127fe99acf9946a69c87ddf759d163ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:05.899625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-0387a855-9910-4c6d-9a8b-eb67bd9dea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:05.976864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1250/2536] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:07.073492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.077994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:07.136907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4f471-337e-4fbb-8e66-d73a52040d2f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.141438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.142051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.142322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.142589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] PATH_INFO: `/v3/users/971f287b39ba4bd3984e05f7cddc4cba` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.143715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=971f287b39ba4bd3984e05f7cddc4cba)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.145595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:07.190630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971f287b39ba4bd3984e05f7cddc4cba'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.197211 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971f287b39ba4bd3984e05f7cddc4cba'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.204078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971f287b39ba4bd3984e05f7cddc4cba'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.204756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971f287b39ba4bd3984e05f7cddc4cba'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.217385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971f287b39ba4bd3984e05f7cddc4cba'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.223047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1287/2537] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:07 2022] DELETE /identity/v3/users/971f287b39ba4bd3984e05f7cddc4cba => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:07.348415 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.348907 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.349009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.369146 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] MFA Rules not processed for user `2b066fface374ff0bc373f7a06a7233a`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:07.370368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.409176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.411059 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.430824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:07.441900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1251/2538] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:07.486957 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff8fe5-77e6-42fc-9f7e-babd63770fdc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.491775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.492410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.492685 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.492950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] PATH_INFO: `/v3/projects/be5f2ad4b99c4d8a87ddffc485ab5b8c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.494146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5f2ad4b99c4d8a87ddffc485ab5b8c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.496119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:07.520864 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:07.545575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5f2ad4b99c4d8a87ddffc485ab5b8c', 'request_id': 'req-9a036a86-3397-49bd-85e5-ea454aef8499'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.551017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5f2ad4b99c4d8a87ddffc485ab5b8c', 'request_id': 'req-9a036a86-3397-49bd-85e5-ea454aef8499'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.557161 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5f2ad4b99c4d8a87ddffc485ab5b8c', 'request_id': 'req-9a036a86-3397-49bd-85e5-ea454aef8499'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.570759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] The token cache is being invalidate because project be5f2ad4b99c4d8a87ddffc485ab5b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:07.571052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.571711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.573817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1288/2539] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:07 2022] DELETE /identity/v3/projects/be5f2ad4b99c4d8a87ddffc485ab5b8c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:07.577985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.590625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8f929-5743-42c3-b208-cc1ee67d6876 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.647728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.648353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.648629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.648895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] PATH_INFO: `/v3/users/127fe99acf9946a69c87ddf759d163ad` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.650012 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=127fe99acf9946a69c87ddf759d163ad)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.652550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:07.699467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127fe99acf9946a69c87ddf759d163ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.707100 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127fe99acf9946a69c87ddf759d163ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.717478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127fe99acf9946a69c87ddf759d163ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.729143 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127fe99acf9946a69c87ddf759d163ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.729851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127fe99acf9946a69c87ddf759d163ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:07.735750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1252/2540] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:07 2022] DELETE /identity/v3/users/127fe99acf9946a69c87ddf759d163ad => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:07.910771 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:07.912328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:07.926650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a036a86-3397-49bd-85e5-ea454aef8499 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:07.989585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:07.990299 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:07.990762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:07.991105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] PATH_INFO: `/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:07.992333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74ffa2aca674a83b0c8be49cfe1e22a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:07.994349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.015207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.016751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.050541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74ffa2aca674a83b0c8be49cfe1e22a', 'request_id': 'req-4700996d-f3e4-48e7-a3fb-c659b256dda8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:08.056736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74ffa2aca674a83b0c8be49cfe1e22a', 'request_id': 'req-4700996d-f3e4-48e7-a3fb-c659b256dda8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:08.064508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74ffa2aca674a83b0c8be49cfe1e22a', 'request_id': 'req-4700996d-f3e4-48e7-a3fb-c659b256dda8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:08.081034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] The token cache is being invalidate because project c74ffa2aca674a83b0c8be49cfe1e22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:08.082095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:08.082527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4700996d-f3e4-48e7-a3fb-c659b256dda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:08.084121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1289/2541] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:07 2022] DELETE /identity/v3/projects/c74ffa2aca674a83b0c8be49cfe1e22a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:08.090288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7237dd-08ca-4a9c-9a57-a776d543ac22 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.090571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7237dd-08ca-4a9c-9a57-a776d543ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.090842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7237dd-08ca-4a9c-9a57-a776d543ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.110289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4b7237dd-08ca-4a9c-9a57-a776d543ac22 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:08.111496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4b7237dd-08ca-4a9c-9a57-a776d543ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.114347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab407-5d4a-454f-8b0e-c25b143e3f80 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.131409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:08.151508 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:08.174753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1290/2542] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:08.178737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.179369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.179645 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.179911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.181773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.182210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.183054 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.183364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.193650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.195198 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.202678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:08.203887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.205293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1253/2543] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:48:08.212157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1291/2544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:08.216225 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.226282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9a38a-c072-4b45-b61f-53f56e8ecde4 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.231237 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.231838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.232113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.232380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.233010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:08.233305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.234862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.246703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1254/2545] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:48:08.250857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.260251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e06b-8039-462a-aaf4-35c94a17e85e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.265017 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.265594 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.265899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.266166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.266785 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.268722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.300931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1292/2546] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:08.305207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.315789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1133-210d-49f6-86c1-fafaaf712d7d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.377461 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.378168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.378352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.378621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.379261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.381199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.404010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1255/2547] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:08 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:08.408294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.424022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db23844-8ca1-4d1f-af05-c615f80921c3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.428716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.429311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.429585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.429853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.430486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.432108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.442810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1293/2548] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:08.446697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.457685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20676a78-1561-4bdc-9f44-cd9c9d23a186 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.463788 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.464467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.464743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.465015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.465650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.467222 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83f602-dfd2-45fa-9fe2-7bf19bdab05d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.478239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1256/2549] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:08.482403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.493285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473d77-44ed-401e-89ed-e4629230b83e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.498683 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.499616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.499616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.499826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] PATH_INFO: `/v3/projects/c780c529fb20437a9f789d7d048613b5/users/a15c2c60d108498bbf43dd5a8d722e0f/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.516177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c780c529fb20437a9f789d7d048613b5, user_id=a15c2c60d108498bbf43dd5a8d722e0f, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.518924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.532792 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1294/2550] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:08 2022] PUT /identity/v3/projects/c780c529fb20437a9f789d7d048613b5/users/a15c2c60d108498bbf43dd5a8d722e0f/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:08.537989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab0d3-c538-445f-8438-e8ab633f27aa None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.538337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab0d3-c538-445f-8438-e8ab633f27aa None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.538722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ab0d3-c538-445f-8438-e8ab633f27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.560346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9d1ab0d3-c538-445f-8438-e8ab633f27aa None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:08.561806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d1ab0d3-c538-445f-8438-e8ab633f27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.630137 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1257/2551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:08.640969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:08.642682 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:08.704532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b148b3-f01c-469b-9332-6f4e0fdcbf64 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:08.708247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:08.708946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:08.709223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:08.709489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:08.718840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:08.720283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:08.729560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1295/2552] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:09.392943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.393469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.393586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.430088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] MFA Rules not processed for user `a15c2c60d108498bbf43dd5a8d722e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:09.432068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:09.436609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:09.513059 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1258/2553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:09.517610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:09.527819 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa13b35-b244-421c-aa83-015e5de15723 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:09.532660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:09.533388 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.533887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.534253 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.534942 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:09.536931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:09.570767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1296/2554] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:09 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:09.574850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:09.592098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca876-0800-481e-b467-77bc4c1c9449 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:09.657753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:09.658468 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.658820 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.659163 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.659819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:09.661750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:09.684294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1259/2555] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:09 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:09.688181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:09.699459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07408e2-1806-4efd-9684-38c73941424c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:09.704517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:09.705191 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.705529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.705744 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.706382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:09.708065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:09.720369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1297/2556] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:09.724520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:09.738643 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363848d-0dbb-4c71-b292-69f13ff177f1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:09.743767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:09.744512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.745507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.745879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] PATH_INFO: `/v3/projects/8061943cd87243b68c14a8b14baad886/users/ef09748fed734d98856979d275a2ba61/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.893006 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8061943cd87243b68c14a8b14baad886, user_id=ef09748fed734d98856979d275a2ba61, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:09.895744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:09.909809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1260/2557] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:09 2022] PUT /identity/v3/projects/8061943cd87243b68c14a8b14baad886/users/ef09748fed734d98856979d275a2ba61/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:09.913700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:09.925965 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58872982-5a09-4b1d-b84c-8c8fe3f5a061 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:09.972317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:09.986074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:09.986687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:09.986964 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:09.987237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:09.987915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:09.989515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc9c35-d396-4d0a-bfdc-e94cf3a71016 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:10.000008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1298/2558] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:10.004168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:10.014909 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779a81-d41e-43c0-89ca-22c965e4202c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:10.021543 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:10.022271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:10.022717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:10.023049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] PATH_INFO: `/v3/projects/8061943cd87243b68c14a8b14baad886/users/ef09748fed734d98856979d275a2ba61/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:10.025347 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8061943cd87243b68c14a8b14baad886, user_id=ef09748fed734d98856979d275a2ba61, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:10.028659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:10.040470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1261/2559] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:10 2022] PUT /identity/v3/projects/8061943cd87243b68c14a8b14baad886/users/ef09748fed734d98856979d275a2ba61/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:10.700874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:10.701359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:10.701609 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:10.732107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] MFA Rules not processed for user `ef09748fed734d98856979d275a2ba61`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:10.733334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:10.814310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1299/2560] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:10.821784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:10.824075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:10.888972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a26fb-2991-46fb-833f-84c74156e1b1 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:10.894175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:10.894799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:10.895094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:10.895566 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:10.907362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:10.957179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:10.958928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:10.968867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1262/2561] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:48:12.321065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:12.322460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:12.334852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16b84-8ef0-4067-b8a1-e362c22c0d1f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:12.338630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:12.339216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:12.339518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:12.339801 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:12.348419 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:12.349824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:12.358993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1300/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:20.964557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=22 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:22.354954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=47 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:25.083894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:25.085433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:25.163071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a445e6-1e86-4664-9811-c477b2fc7ae1 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:25.168110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:25.168743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:25.169021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:25.169296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:25.171015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:25.182268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:25.184484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:25.194799 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1263/2563] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:25.639231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:25.701643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d97cd-b2b9-4381-945a-9f5936eec6c1 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:25.706035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:25.706657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:25.706931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:25.707197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] PATH_INFO: `/v3/users/a15c2c60d108498bbf43dd5a8d722e0f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:25.708345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15c2c60d108498bbf43dd5a8d722e0f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:25.710227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:25.755797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15c2c60d108498bbf43dd5a8d722e0f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:25.762622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15c2c60d108498bbf43dd5a8d722e0f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:25.770233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15c2c60d108498bbf43dd5a8d722e0f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:25.770844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15c2c60d108498bbf43dd5a8d722e0f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:25.783317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15c2c60d108498bbf43dd5a8d722e0f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:25.789067 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1301/2564] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:25 2022] DELETE /identity/v3/users/a15c2c60d108498bbf43dd5a8d722e0f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:25.967774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:25.979536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1abd1-3ddf-485b-8cbe-f56921eadff2 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.037705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.038260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.038536 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.038803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] PATH_INFO: `/v3/projects/c780c529fb20437a9f789d7d048613b5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.039959 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c780c529fb20437a9f789d7d048613b5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.041836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.087011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c780c529fb20437a9f789d7d048613b5', 'request_id': 'req-6d968507-0440-47ea-b318-7c1f051fce92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.092949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c780c529fb20437a9f789d7d048613b5', 'request_id': 'req-6d968507-0440-47ea-b318-7c1f051fce92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.098833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c780c529fb20437a9f789d7d048613b5', 'request_id': 'req-6d968507-0440-47ea-b318-7c1f051fce92'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.110857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] The token cache is being invalidate because project c780c529fb20437a9f789d7d048613b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:26.111140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.111787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.113239 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1264/2565] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:25 2022] DELETE /identity/v3/projects/c780c529fb20437a9f789d7d048613b5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:26.117266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.118684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:26.131560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae6254-dff7-41ca-9afa-278edfa0e7a1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.187794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.188423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.188700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.188968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] PATH_INFO: `/v3/users/ef09748fed734d98856979d275a2ba61` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.190079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef09748fed734d98856979d275a2ba61)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.192024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.213679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:26.239881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef09748fed734d98856979d275a2ba61'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.246899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef09748fed734d98856979d275a2ba61'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.254302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef09748fed734d98856979d275a2ba61'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.254940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef09748fed734d98856979d275a2ba61'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.267237 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ed93af02-2224-492f-bc18-6bc9b6607944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef09748fed734d98856979d275a2ba61'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.272941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1302/2566] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:26 2022] DELETE /identity/v3/users/ef09748fed734d98856979d275a2ba61 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:26.444250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.445748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:26.459067 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d968507-0440-47ea-b318-7c1f051fce92 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.476343 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:26.516809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.517457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.517737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.518007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] PATH_INFO: `/v3/projects/8061943cd87243b68c14a8b14baad886` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.519108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8061943cd87243b68c14a8b14baad886)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.521028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.565487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8061943cd87243b68c14a8b14baad886', 'request_id': 'req-b35b9342-b11e-45fa-aabc-c565ce5651b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.571165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8061943cd87243b68c14a8b14baad886', 'request_id': 'req-b35b9342-b11e-45fa-aabc-c565ce5651b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.578376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8061943cd87243b68c14a8b14baad886', 'request_id': 'req-b35b9342-b11e-45fa-aabc-c565ce5651b3'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.590935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] The token cache is being invalidate because project 8061943cd87243b68c14a8b14baad886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:26.591258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.591950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-b35b9342-b11e-45fa-aabc-c565ce5651b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:26.593397 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1265/2567] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:26 2022] DELETE /identity/v3/projects/8061943cd87243b68c14a8b14baad886 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:26.598255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.598539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.598807 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.617833 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:26.619015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:26.677224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1303/2568] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:26.685974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.686255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.686522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.705826 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:26.707007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:26.716644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1266/2569] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:26.720700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.730458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f3e16-10e7-4b85-b0ce-4f907fe8c00a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.734975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.735599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.735874 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.736140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.736986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:26.737285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.738870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.750610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1304/2570] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:26.754936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.764941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3813e1-a1ac-4012-85c1-51d863092781 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.769534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.770117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.770393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.770667 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.771317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.773192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.799456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1267/2571] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:26 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:26.803441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.813765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5ecea-d498-4334-a8d6-619cd68d10a7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.870396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.870997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.871300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.871570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.872187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.874579 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.895081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1305/2572] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:26 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:26.899150 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.909354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c8083-9eef-4aef-bc72-eb06711361a3 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.913862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.914444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.914716 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.914980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.915632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.917684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.927069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1268/2573] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:48:26.930722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.941144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd405-f8f2-4598-8619-5dbcd1a43857 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.945940 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.946525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.946802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.947073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.947735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.949288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595925-c511-4d7b-bd90-bff76c250051 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:26.959600 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1306/2574] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:26.963776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:26.973353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320099-d173-4251-ba3a-74e90538e5a0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:26.977876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:26.978532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:26.978807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:26.979073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] PATH_INFO: `/v3/projects/fc274f1e4784469e8483b9d22d256773/users/b3813b5c189a44579acda2af5af27df5/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:26.994373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc274f1e4784469e8483b9d22d256773, user_id=b3813b5c189a44579acda2af5af27df5, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:26.997631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.010079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1269/2575] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:26 2022] PUT /identity/v3/projects/fc274f1e4784469e8483b9d22d256773/users/b3813b5c189a44579acda2af5af27df5/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:27.021540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.021824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.022097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.029959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:27.051157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] MFA Rules not processed for user `b3813b5c189a44579acda2af5af27df5`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:27.052408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:27.114968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1307/2576] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:27.119500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.168218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:27.183625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888e6dc-7026-49dc-a7a8-2c7998ec55a9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.188369 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.188968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.189242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.189509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.190131 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.192042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.217918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1270/2577] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:27.222089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.233351 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368ea3c-bbd4-4e14-8040-c6d339071ea7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.287702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.288300 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.288578 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.288851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.289462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.291391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.317082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1308/2578] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:27 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:27.318270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.328357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951de9c-3961-4687-86cc-184587bf1a78 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.332852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.333433 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.333704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.333966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.334698 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.336760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.347306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1271/2579] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:48:27.351210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.361638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0dfca-3782-49d9-bafc-bce7d948f04a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.366105 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.366674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.366972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.367255 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] PATH_INFO: `/v3/projects/58943c8f8d3b417484e514ed56e267d5/users/7c3fb8ebc8614d3da80dd461febe92ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.381484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58943c8f8d3b417484e514ed56e267d5, user_id=7c3fb8ebc8614d3da80dd461febe92ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.384128 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.396569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1309/2580] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:27 2022] PUT /identity/v3/projects/58943c8f8d3b417484e514ed56e267d5/users/7c3fb8ebc8614d3da80dd461febe92ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:27.400429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.411773 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e16c-1e38-48db-8f10-0906fa3cffcd admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.466295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.466887 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.467165 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.467463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.468086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.469647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed343ac-6712-4f3a-88fe-cad97b3a749f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.478835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1272/2581] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:48:27.482961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.493162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2138c19-8a5b-4e1c-808a-ce143ad197e3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.498548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.499203 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.499511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.499783 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] PATH_INFO: `/v3/projects/58943c8f8d3b417484e514ed56e267d5/users/7c3fb8ebc8614d3da80dd461febe92ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.501678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58943c8f8d3b417484e514ed56e267d5, user_id=7c3fb8ebc8614d3da80dd461febe92ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.504373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.516538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1310/2582] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:27 2022] PUT /identity/v3/projects/58943c8f8d3b417484e514ed56e267d5/users/7c3fb8ebc8614d3da80dd461febe92ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:27.527037 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb092a-e461-4e3c-b4ca-e3105d6ccc77 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.527356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb092a-e461-4e3c-b4ca-e3105d6ccc77 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.527632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb092a-e461-4e3c-b4ca-e3105d6ccc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.555154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-64bb092a-e461-4e3c-b4ca-e3105d6ccc77 None None] MFA Rules not processed for user `7c3fb8ebc8614d3da80dd461febe92ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:27.556408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-64bb092a-e461-4e3c-b4ca-e3105d6ccc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:27.624359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1273/2583] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:27.635020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:27.636786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:27.688647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:27.694806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2234f7a-ce12-4d36-869f-ff7e7f8a4740 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:27.698651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:27.699259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:27.699549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:27.699817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:27.758563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:27.760045 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:27.769376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1311/2584] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:29.468978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:29.469435 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:29.469562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:29.489106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:29.490286 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:29.527679 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:29.547156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1274/2585] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:29.568247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:29.569693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:29.639626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc688c7-1b9b-43e1-8cce-29f8c65392f3 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:29.644655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:29.645259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:29.645539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:29.645811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:29.654489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:29.656033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bf8c9-ab73-4687-8321-4de6e436ccfa service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:29.664065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1312/2586] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:48:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:48:31.389761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:31.460315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7019-7bf1-4e26-8f30-4a623ecfe92e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:31.466087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:31.466743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:31.467052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:31.467353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] PATH_INFO: `/v3/users/b3813b5c189a44579acda2af5af27df5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:31.468495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3813b5c189a44579acda2af5af27df5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:31.470387 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:31.526005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3813b5c189a44579acda2af5af27df5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:31.539060 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3813b5c189a44579acda2af5af27df5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:31.547814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3813b5c189a44579acda2af5af27df5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:31.559945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3813b5c189a44579acda2af5af27df5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:31.560654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3813b5c189a44579acda2af5af27df5'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:31.567140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1275/2587] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:31 2022] DELETE /identity/v3/users/b3813b5c189a44579acda2af5af27df5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:31.571452 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:31.571939 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:31.572148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:31.597516 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:31.598840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:31.687120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1313/2588] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:31.697659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:31.699703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:31.773573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969d5e2-135a-4c4c-a0a1-9c3718c48658 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:31.777559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:31.778175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:31.778593 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:31.778877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:31.797678 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:31.800835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:31.811941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1276/2589] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:32.125659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:32.127775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:32.146921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0d67-78d0-41a6-8731-6edef6a7da1c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:32.160162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:32.165182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:32.166037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:32.166313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] PATH_INFO: `/v3/projects/fc274f1e4784469e8483b9d22d256773` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:32.167754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc274f1e4784469e8483b9d22d256773)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:32.169681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:32.217313 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:32.239485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc274f1e4784469e8483b9d22d256773', 'request_id': 'req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.246758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc274f1e4784469e8483b9d22d256773', 'request_id': 'req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.256066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc274f1e4784469e8483b9d22d256773', 'request_id': 'req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.271390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] The token cache is being invalidate because project fc274f1e4784469e8483b9d22d256773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:32.271687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.272406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.274143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1314/2590] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:32 2022] DELETE /identity/v3/projects/fc274f1e4784469e8483b9d22d256773 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:32.277926 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:32.288042 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c02ab-eccf-46be-906d-b5fdaefe19ce service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:32.293565 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:32.364840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:32.364840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:32.364840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:32.364840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] PATH_INFO: `/v3/users/7c3fb8ebc8614d3da80dd461febe92ad` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:32.365382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3fb8ebc8614d3da80dd461febe92ad)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:32.365382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:32.423774 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3fb8ebc8614d3da80dd461febe92ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.432721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3fb8ebc8614d3da80dd461febe92ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.439669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3fb8ebc8614d3da80dd461febe92ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.456219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3fb8ebc8614d3da80dd461febe92ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.459861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6f0013d8-dd0b-4ac8-b1a6-edc11d7091b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3fb8ebc8614d3da80dd461febe92ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.471933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1277/2591] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:32 2022] DELETE /identity/v3/users/7c3fb8ebc8614d3da80dd461febe92ad => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:32.760681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:32.762701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:32.777092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad394c-1901-4b0a-a8ee-7c7bcaddddd1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:32.861160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:32.861791 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:32.862194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:32.862471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] PATH_INFO: `/v3/projects/58943c8f8d3b417484e514ed56e267d5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:32.863620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=58943c8f8d3b417484e514ed56e267d5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:32.865664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:32.921580 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58943c8f8d3b417484e514ed56e267d5', 'request_id': 'req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.928857 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58943c8f8d3b417484e514ed56e267d5', 'request_id': 'req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.936753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58943c8f8d3b417484e514ed56e267d5', 'request_id': 'req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.953147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] The token cache is being invalidate because project 58943c8f8d3b417484e514ed56e267d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:32.953463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.954120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a0f4b168-2106-495d-9cfd-a4767a1ad9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:32.956167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1315/2592] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:32 2022] DELETE /identity/v3/projects/58943c8f8d3b417484e514ed56e267d5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:32.961367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:32.961655 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:32.961924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:32.984459 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:32.985901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:33.051128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1278/2593] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:33.058725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.059013 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.059310 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.081486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:33.083206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:33.095298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1316/2594] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:33.096610 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.106452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf93b62-5078-4f34-b0f3-55517c9c530f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.111278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.111929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.112208 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.112510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.113243 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:33.113541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.115346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.128561 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1279/2595] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:33.132997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.144963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a774f2f-feb3-46be-ba50-245128acc053 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.150249 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.150890 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.151379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.152632 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.153377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.155439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.190488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1317/2596] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:33.194438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.205464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9899-4b33-4587-bd28-df5dbcb8091c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.218099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:33.297632 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.298399 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.298756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.299090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.299841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.302004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.331086 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1280/2597] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:33.332301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.344707 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6fe52-918b-4b06-950b-17fe9f456b5c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.351673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.352375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.352684 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.352961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.353643 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.355575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.375372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1318/2598] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:33.379379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.392919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac6f7-aa3e-40b3-b485-aedcb7321a7a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.400654 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.402043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.402525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.402802 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.403796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.405747 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4a79-e6f8-46c3-8aeb-6967e4682734 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.426257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1281/2599] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:48:33.430099 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.439337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:33.444800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a3ce-5344-427f-bb60-1baf729171e3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.454165 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.455058 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.455560 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.455894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] PATH_INFO: `/v3/projects/dd226f51ff4b4d00b4a76c11ea64bf36/users/269b91d81cac49faaca3f43a71625733/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.473968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd226f51ff4b4d00b4a76c11ea64bf36, user_id=269b91d81cac49faaca3f43a71625733, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.476884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.493871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1319/2600] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:33 2022] PUT /identity/v3/projects/dd226f51ff4b4d00b4a76c11ea64bf36/users/269b91d81cac49faaca3f43a71625733/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:33.505720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.506046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.506350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.542419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] MFA Rules not processed for user `269b91d81cac49faaca3f43a71625733`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:33.544207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:33.629254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1282/2601] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:33.633602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.711810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cf986-eea0-4db1-a198-a263117fbe48 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.717520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.718195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.718475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.718742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.719394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.722264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.760549 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1320/2602] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:33.762434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.774784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf39a2a-1163-4bbc-a7d6-ae7b682c7d73 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.841113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.841113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.841458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.841548 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.842322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.844456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.869569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1283/2603] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:33 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:33.871672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.884243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37235847-fb67-4786-8887-1f188b6eaaa3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.890672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.891411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.891727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.892003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.892697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.894412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.906629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1321/2604] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:33.911122 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.924884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bc7ed-14ba-4bf5-bee2-aefe74368745 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.931013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.931852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.932129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.932526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.933783 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.935396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a93d7-c9b8-41a2-b6bb-6bff641331d7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:33.947488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1284/2605] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:33.951597 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:33.962793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7d8c4-7adc-4d30-b014-f8d5b0d436d1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:33.972777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:33.973436 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:33.973887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:33.974106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] PATH_INFO: `/v3/projects/92b8fb1b12e645ebbf8f35f00d1f53fe/users/a414673d870243fea685d254a47f066f/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:33.992700 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b8fb1b12e645ebbf8f35f00d1f53fe, user_id=a414673d870243fea685d254a47f066f, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:33.998966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.024879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1322/2606] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:33 2022] PUT /identity/v3/projects/92b8fb1b12e645ebbf8f35f00d1f53fe/users/a414673d870243fea685d254a47f066f/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:34.028172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.028590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.028871 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.038872 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:34.071094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] MFA Rules not processed for user `a414673d870243fea685d254a47f066f`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:34.072351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:34.163388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1285/2607] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:34.168011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.243005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f90580-47d4-498a-b14c-171ffbf2f99f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.248628 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.249246 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.249526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.249796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.250423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.252364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.284029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1323/2608] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:34 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:34.285682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.299943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8233cbf-9015-43e9-8745-bc26efb3a549 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.360029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.360639 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.360918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.361191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.361821 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.363790 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.387283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1286/2609] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:34 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:34.390101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.402317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ba5a8-5772-4173-b389-16289a74a08e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.407993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.408618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.409267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.409584 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.410141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.412033 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.430599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1324/2610] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:34.432507 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.445861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d4eb-d1d0-4023-96a3-6e0d95ef49b9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.453266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.454109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.454483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.454851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] PATH_INFO: `/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0/users/04eba7a2f0914aba870e8cbc6b3476d2/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.478030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aaa58dc06b4e9fb344d6ab0f5164f0, user_id=04eba7a2f0914aba870e8cbc6b3476d2, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.481700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.498409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1287/2611] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:34 2022] PUT /identity/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0/users/04eba7a2f0914aba870e8cbc6b3476d2/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:34.502477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.509591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:34.515835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9a48-1faa-43c9-ae3a-0bc4c16afa64 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.581913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.582986 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.583527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.583983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.584818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.587566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc28781-6c04-4e18-b294-f4f4239a2f9f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.608741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1325/2612] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:34.610149 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.622943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d135bd-7862-4b42-9f17-5911ba186e1d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.628325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.629033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.629400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.629779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] PATH_INFO: `/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0/users/04eba7a2f0914aba870e8cbc6b3476d2/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.631971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aaa58dc06b4e9fb344d6ab0f5164f0, user_id=04eba7a2f0914aba870e8cbc6b3476d2, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.634715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.646750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1288/2613] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:34 2022] PUT /identity/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0/users/04eba7a2f0914aba870e8cbc6b3476d2/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:34.661030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.661335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.661671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.695329 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] MFA Rules not processed for user `04eba7a2f0914aba870e8cbc6b3476d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:34.696511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:34.781467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1326/2614] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:34.794446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:34.796326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:34.854353 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:34.868846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3c56c-c19b-46ae-b85f-eacc22d70805 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:34.874816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:34.875885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:34.876335 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:34.876797 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:34.945064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:34.946559 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:34.960322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1289/2615] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:36.711751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:36.713240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:36.732520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeed4c-5499-4399-bbd2-4d3aaaf73a3d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:36.736582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:36.737320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:36.737658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:36.737973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:36.800015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:36.801917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:36.811878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1327/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:37.421734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:37.434642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0927f1d-3301-4726-9e8a-6819ea0a05a6 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:37.438996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:37.439741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:37.439949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:37.440211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:37.450699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:37.452179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e77cc-cc32-488e-a73c-ebbffe682024 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:37.463174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1290/2617] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:41.491894 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:41.522898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:41.564148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7d4b0-c68c-48fe-90f1-351bcd5f7722 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:41.568987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:41.570247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:41.570532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:41.570804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] PATH_INFO: `/v3/users/269b91d81cac49faaca3f43a71625733` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:41.571966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269b91d81cac49faaca3f43a71625733)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:41.574483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:41.652344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269b91d81cac49faaca3f43a71625733'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:41.661034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269b91d81cac49faaca3f43a71625733'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:41.671903 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269b91d81cac49faaca3f43a71625733'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:41.672518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269b91d81cac49faaca3f43a71625733'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:41.687080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269b91d81cac49faaca3f43a71625733'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:41.694025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1328/2618] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:41 2022] DELETE /identity/v3/users/269b91d81cac49faaca3f43a71625733 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:41.699823 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:41.701523 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:41.702024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:41.724590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:41.726025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:41.823696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1291/2619] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:41.831395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:41.833654 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:41.912001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d0526-42f1-43d2-9cfe-8ecdf2156264 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:41.915784 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:41.916407 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:41.917186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:41.917466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:41.932148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:41.934143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:41.944625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1329/2620] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:48:42.250987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:42.253047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:42.275388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ab91a-15d3-43ed-82d4-0951ca5e8dab None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:42.282035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:42.282677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:42.282949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:42.283283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] PATH_INFO: `/v3/projects/dd226f51ff4b4d00b4a76c11ea64bf36` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:42.284512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd226f51ff4b4d00b4a76c11ea64bf36)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:42.286363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:42.362363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd226f51ff4b4d00b4a76c11ea64bf36', 'request_id': 'req-02572d60-82dc-4277-8977-a7d58fce747b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.369075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd226f51ff4b4d00b4a76c11ea64bf36', 'request_id': 'req-02572d60-82dc-4277-8977-a7d58fce747b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.378401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd226f51ff4b4d00b4a76c11ea64bf36', 'request_id': 'req-02572d60-82dc-4277-8977-a7d58fce747b'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.391844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] The token cache is being invalidate because project dd226f51ff4b4d00b4a76c11ea64bf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:42.392242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.392875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.395080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1292/2621] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:42 2022] DELETE /identity/v3/projects/dd226f51ff4b4d00b4a76c11ea64bf36 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:42.399235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:42.413353 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443e5c2-0191-46bd-8ef2-a73feccebc96 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:42.465524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:42.482277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:42.482913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:42.483207 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:42.483506 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] PATH_INFO: `/v3/users/a414673d870243fea685d254a47f066f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:42.484635 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a414673d870243fea685d254a47f066f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:42.486591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:42.540820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a414673d870243fea685d254a47f066f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.548471 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a414673d870243fea685d254a47f066f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.556748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a414673d870243fea685d254a47f066f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.557461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a414673d870243fea685d254a47f066f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.571182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a414673d870243fea685d254a47f066f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:42.578390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1330/2622] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:42 2022] DELETE /identity/v3/users/a414673d870243fea685d254a47f066f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:42.891280 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:42.893479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:42.909597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02572d60-82dc-4277-8977-a7d58fce747b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:42.917094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:42.988270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:42.988812 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:42.989083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:42.989349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] PATH_INFO: `/v3/projects/92b8fb1b12e645ebbf8f35f00d1f53fe` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:42.990486 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b8fb1b12e645ebbf8f35f00d1f53fe)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:42.993502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:43.062450 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b8fb1b12e645ebbf8f35f00d1f53fe', 'request_id': 'req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.071470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b8fb1b12e645ebbf8f35f00d1f53fe', 'request_id': 'req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.080701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b8fb1b12e645ebbf8f35f00d1f53fe', 'request_id': 'req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.095167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] The token cache is being invalidate because project 92b8fb1b12e645ebbf8f35f00d1f53fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:43.095616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.096844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.098519 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1293/2623] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:42 2022] DELETE /identity/v3/projects/92b8fb1b12e645ebbf8f35f00d1f53fe => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:43.102513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:43.104086 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:43.118343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4b3e-13a7-4450-8121-c4326db874ef admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:43.193855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:43.194520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:43.194795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:43.195064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] PATH_INFO: `/v3/users/04eba7a2f0914aba870e8cbc6b3476d2` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:43.196251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04eba7a2f0914aba870e8cbc6b3476d2)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:43.199113 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:43.265260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04eba7a2f0914aba870e8cbc6b3476d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.273234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04eba7a2f0914aba870e8cbc6b3476d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.281357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04eba7a2f0914aba870e8cbc6b3476d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.282108 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04eba7a2f0914aba870e8cbc6b3476d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.287103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:43.304406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bea6d2f4-3933-4609-9a48-f63b487824c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04eba7a2f0914aba870e8cbc6b3476d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.311845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1331/2624] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:43 2022] DELETE /identity/v3/users/04eba7a2f0914aba870e8cbc6b3476d2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:43.652709 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:43.656665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:43.684514 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcdbb8-27cc-4c08-b8cb-51b3caec079d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:43.749229 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:43.749771 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:43.750075 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:43.750463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] PATH_INFO: `/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:43.751616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28aaa58dc06b4e9fb344d6ab0f5164f0)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:43.753501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:43.822970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:43.830607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28aaa58dc06b4e9fb344d6ab0f5164f0', 'request_id': 'req-2a04cfeb-909e-457c-87a1-930eab9a6b85'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.837255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28aaa58dc06b4e9fb344d6ab0f5164f0', 'request_id': 'req-2a04cfeb-909e-457c-87a1-930eab9a6b85'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.843722 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28aaa58dc06b4e9fb344d6ab0f5164f0', 'request_id': 'req-2a04cfeb-909e-457c-87a1-930eab9a6b85'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.858336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] The token cache is being invalidate because project 28aaa58dc06b4e9fb344d6ab0f5164f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:43.858745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.859509 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-2a04cfeb-909e-457c-87a1-930eab9a6b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:43.861317 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1294/2625] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:43 2022] DELETE /identity/v3/projects/28aaa58dc06b4e9fb344d6ab0f5164f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:43.866027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:43.866530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:43.866708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:43.890664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:43.891901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:43.967290 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1332/2626] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:48:43.974723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:43.975466 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:43.975571 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:43.999044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:44.000516 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:44.010255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1295/2627] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:44.015524 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.029016 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc10e7a-5dce-4455-aa92-2a1447e0057c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.035671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.036610 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.036884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.037146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.038206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:44.038519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.041178 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.060822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1333/2628] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:44.062186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.072749 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec097ba-cbc6-4cc7-8748-aba5ff9bcfe9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.077955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.078813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.079212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.079605 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.080322 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.082923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.118188 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1296/2629] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:44 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:44.119402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.131637 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d69aa9-ceaa-4ed9-8911-9a803f9ac353 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.211423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.212118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.212457 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.212798 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.213527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.215546 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.243974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1334/2630] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:44 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:44.250083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.265529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e892f3-0869-4fee-8f59-43f90e0a1064 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.272481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.273157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.273533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.273864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.274564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.276518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.288354 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1297/2631] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:44.294417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.306037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca74c-27a9-44a0-9838-733819e8c55d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.313547 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.314257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.314482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.314738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.315422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.317231 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cccc7-1370-4d98-aeed-18b0418f1c0c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.333180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1335/2632] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:44.334328 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.346863 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085708cb-7041-457c-8b3c-4d1acfd4c458 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.353000 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.353782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.355053 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.355359 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] PATH_INFO: `/v3/projects/90bc5215aca5438a9e7363934e49eb6b/users/6ee98b0b2658465ead382cb97eb8ae93/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.372592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bc5215aca5438a9e7363934e49eb6b, user_id=6ee98b0b2658465ead382cb97eb8ae93, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.375309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.389123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1298/2633] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:44 2022] PUT /identity/v3/projects/90bc5215aca5438a9e7363934e49eb6b/users/6ee98b0b2658465ead382cb97eb8ae93/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:44.399504 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c727e6-4780-45c4-a0ba-235621d9e3bd None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.399856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c727e6-4780-45c4-a0ba-235621d9e3bd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.400219 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c727e6-4780-45c4-a0ba-235621d9e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.433389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-67c727e6-4780-45c4-a0ba-235621d9e3bd None None] MFA Rules not processed for user `6ee98b0b2658465ead382cb97eb8ae93`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:44.434614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67c727e6-4780-45c4-a0ba-235621d9e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:44.478879 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:44.511532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1336/2634] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:44.521048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:44.524376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:44.584984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb409f3-974e-416e-9bb1-5603d9e52bf2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:44.589445 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:44.590046 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:44.590324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:44.590585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:44.598910 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:44.601167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:44.612431 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1299/2635] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:45.390631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:45.391157 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:45.391321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:45.411667 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:45.413368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:45.471109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1337/2636] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:45.484212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:45.485625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:45.554693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e8e7-d3b2-43cf-b757-2ac5ddb3a49c service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:45.560691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:45.561319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:45.561680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:45.561875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:45.570791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:45.572408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:45.576007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:45.581498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1300/2637] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:48:47.516634 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:47.518081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:47.586677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e02da7-a840-476d-ab0c-6b621b6894a7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:47.591298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:47.591946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:47.592222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:47.592518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] PATH_INFO: `/v3/users/2b066fface374ff0bc373f7a06a7233a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:47.593653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b066fface374ff0bc373f7a06a7233a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:47.600668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:47.644222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b066fface374ff0bc373f7a06a7233a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.651188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b066fface374ff0bc373f7a06a7233a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.658847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b066fface374ff0bc373f7a06a7233a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.659658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b066fface374ff0bc373f7a06a7233a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.671691 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-432460f0-ea04-4817-8f33-a44e6e044fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b066fface374ff0bc373f7a06a7233a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.677515 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1338/2638] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:47 2022] DELETE /identity/v3/users/2b066fface374ff0bc373f7a06a7233a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:47.863156 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:47.874434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf50eb-b9ba-47ca-8b9d-04de21c1af22 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:47.930018 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:47.930631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:47.930903 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:47.931168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] PATH_INFO: `/v3/projects/e3959e559ae642e88844b20c26cc39d5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:47.932929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3959e559ae642e88844b20c26cc39d5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:47.934807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:47.982444 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3959e559ae642e88844b20c26cc39d5', 'request_id': 'req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.987992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3959e559ae642e88844b20c26cc39d5', 'request_id': 'req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:47.994192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3959e559ae642e88844b20c26cc39d5', 'request_id': 'req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:48.007116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] The token cache is being invalidate because project e3959e559ae642e88844b20c26cc39d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:48.007425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:48.008036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a8cf5b4-ebe1-4fbf-9933-a73c69043582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:48.009526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1301/2639] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:47 2022] DELETE /identity/v3/projects/e3959e559ae642e88844b20c26cc39d5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:48.014306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.014716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.014880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.024068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:48.036100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:48.037312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:48.098240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1339/2640] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:48.106484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.106702 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.106970 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.127808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:48.128999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:48.136758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1302/2641] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:48.141020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.151564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98077703-6d03-4dc0-9234-64d347f04c61 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.156243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.156839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.157118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.157385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.158031 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:48.158332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.159978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.173348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1340/2642] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:48.177496 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.186715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0c03d-d3ed-4e80-b01e-6d29d1043560 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.191344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.192204 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.192481 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.192750 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.193364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.195224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.224139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1303/2643] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:48.228306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.238697 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672b653-5046-4266-9c5b-f19607a9408b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.296577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.297189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.297469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.297739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.298364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.300304 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.320751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1341/2644] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:48 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:48:48.324842 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.334882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfce3f-86f4-44f0-a605-4f404e8e50dc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.340190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.340770 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.341040 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.341301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.341953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.343532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.352992 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1304/2645] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:48.357247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.367572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63759cd-eb34-46ce-8397-91274378ed23 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.372384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.372988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.373261 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.373527 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.374337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.375978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c3ac5-3161-4fd4-85e0-c63865974ad4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.386904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1342/2646] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:48:48.391102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.401423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97afe70-7ffd-4f33-ae93-0c2847d32331 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.406116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.406791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.407065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.407392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] PATH_INFO: `/v3/projects/540370799c5c4668aed26949bd7102fc/users/36973e378ccb4e90b0da2db9d642ebfb/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.423719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=540370799c5c4668aed26949bd7102fc, user_id=36973e378ccb4e90b0da2db9d642ebfb, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.426321 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.439074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1305/2647] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:48 2022] PUT /identity/v3/projects/540370799c5c4668aed26949bd7102fc/users/36973e378ccb4e90b0da2db9d642ebfb/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:48:48.449122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.449412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.449704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.481101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] MFA Rules not processed for user `36973e378ccb4e90b0da2db9d642ebfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:48.482305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:48.543645 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:48.551229 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1343/2648] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:48.558794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:48.560713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:48.590685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:48.621455 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5817d-2aa2-433b-ab11-7be5afefa42c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:48.625057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:48.625659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:48.625950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:48.626203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:48.634316 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:48.636284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda1004-6768-48e2-886f-50668fedb807 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:48.644919 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1306/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:51.196024 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:51.260565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819ecc2-21f6-4788-a933-e28be9e6f568 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:51.265119 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:51.265752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:51.266052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:51.266322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] PATH_INFO: `/v3/users/36973e378ccb4e90b0da2db9d642ebfb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:51.267679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36973e378ccb4e90b0da2db9d642ebfb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:51.269631 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:51.316810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36973e378ccb4e90b0da2db9d642ebfb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.323666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36973e378ccb4e90b0da2db9d642ebfb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.330991 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36973e378ccb4e90b0da2db9d642ebfb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.331630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36973e378ccb4e90b0da2db9d642ebfb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.346116 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36973e378ccb4e90b0da2db9d642ebfb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.352985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1344/2650] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:48:51 2022] DELETE /identity/v3/users/36973e378ccb4e90b0da2db9d642ebfb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:51.357781 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:51.358255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:51.358352 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:51.376388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:51.377535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:51.439660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1307/2651] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:51.449617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:51.452320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:51.513110 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246a63-be61-4b8d-9d2e-b3c9710c7248 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:51.516731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:51.517332 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:51.517608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:51.517946 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:51.528395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:51.529845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d44147-53d5-4608-9e76-f28434776d23 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:51.539670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1345/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:48:51.813062 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:51.814861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:51.829125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ef265-c816-4e1e-bae1-594b8079d708 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:51.837830 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:51.839032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:51.839340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:51.839611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] PATH_INFO: `/v3/projects/540370799c5c4668aed26949bd7102fc` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:51.840777 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540370799c5c4668aed26949bd7102fc)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:51.842624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:51.890831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540370799c5c4668aed26949bd7102fc', 'request_id': 'req-6616a804-1011-4974-ab72-33061c422630'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.896323 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540370799c5c4668aed26949bd7102fc', 'request_id': 'req-6616a804-1011-4974-ab72-33061c422630'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.902408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540370799c5c4668aed26949bd7102fc', 'request_id': 'req-6616a804-1011-4974-ab72-33061c422630'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.914470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] The token cache is being invalidate because project 540370799c5c4668aed26949bd7102fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:48:51.914751 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.915396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-6616a804-1011-4974-ab72-33061c422630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:48:51.916897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1308/2653] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:48:51 2022] DELETE /identity/v3/projects/540370799c5c4668aed26949bd7102fc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:51.922641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:51.922954 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:51.923230 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:51.943522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:51.944639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:51.961953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:52.006386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1346/2654] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:52.090692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.090982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.091267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.112839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:52.114057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:52.122489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1309/2655] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:52.126853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.137277 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6541d-be1f-4e58-98ed-9c4e6137e348 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.141899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.142512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.142786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.143051 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.143722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:48:52.144046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.145723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.158090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1347/2656] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:48:52.162840 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.172078 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14615bcc-7f91-49b7-bc5a-5df5c8e238a9 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.176682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.177261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.177533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.177798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.178401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.180458 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.208547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1310/2657] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:48:52 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:52.213240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.224182 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945608-12a7-4163-abb7-1f7b4acf200e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.280996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.281596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.281871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.282138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.282764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.284731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.305923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1348/2658] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:48:52 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:48:52.310434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.320607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3104-b0ee-45ec-84d7-8a7adb873650 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.325178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.325772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.326064 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.326309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.326938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.328532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.338712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1311/2659] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:52.342686 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.352715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b444fb-e513-4d10-ab32-032d47a96927 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.357931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.358672 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.358952 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.359221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.360152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.361962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec494ca-055b-4cb9-9dbc-0ce6ece8c515 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.377035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1349/2660] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:48:52.378357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.389052 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6f165-94cc-4304-9168-07a52ae7bd80 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.395482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.397031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.397590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.398134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] PATH_INFO: `/v3/projects/eb295ed9b83e4133a0448712b533ea54/users/40fc54300083442a835d58d483fec7be/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.410800 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:48:52.420500 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb295ed9b83e4133a0448712b533ea54, user_id=40fc54300083442a835d58d483fec7be, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.423547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.446738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1312/2661] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:48:52 2022] PUT /identity/v3/projects/eb295ed9b83e4133a0448712b533ea54/users/40fc54300083442a835d58d483fec7be/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:48:52.458348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.458681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.458904 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.491837 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] MFA Rules not processed for user `40fc54300083442a835d58d483fec7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:48:52.493064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:52.565035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1350/2662] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:48:52.576234 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:48:52.579388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:48:52.644504 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98529525-dce1-4c29-8e32-d4cb3fbf3c5b admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:48:52.648495 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:48:52.649120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:48:52.649394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:48:52.649659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:48:52.659526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:48:52.660953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980527-9153-43d3-8b7c-d31d83b61637 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:48:52.670680 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1313/2663] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:02.445999 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:02.464786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:02.508828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ebfd7-a414-4188-b849-3e4ae9f45891 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:02.513267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:02.513893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:02.514150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:02.514417 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] PATH_INFO: `/v3/users/40fc54300083442a835d58d483fec7be` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:02.515552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fc54300083442a835d58d483fec7be)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:02.517465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:02.565381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fc54300083442a835d58d483fec7be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:02.573146 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fc54300083442a835d58d483fec7be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:02.581235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fc54300083442a835d58d483fec7be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:02.582184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fc54300083442a835d58d483fec7be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:02.596715 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fc54300083442a835d58d483fec7be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:02.603175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1351/2664] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:02 2022] DELETE /identity/v3/users/40fc54300083442a835d58d483fec7be => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:02.608115 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:02.608583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:02.608682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:02.627419 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:02.628609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:02.689808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1314/2665] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:02.699460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:02.701392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:02.757009 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33597a6-9186-4eb3-b5f7-2cdc8bc84411 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:02.760596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:02.761189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:02.761464 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:02.761732 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:02.771348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:02.772752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55300c8d-ee1d-452f-bbdf-b7429b5a461a service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:02.782633 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1352/2666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:03.043272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.044703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:03.056302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f94c6-c1e4-4aeb-a440-d125e1a6420b None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.061693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.062320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.062595 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.062883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] PATH_INFO: `/v3/projects/eb295ed9b83e4133a0448712b533ea54` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.064039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb295ed9b83e4133a0448712b533ea54)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.065917 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.112396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb295ed9b83e4133a0448712b533ea54', 'request_id': 'req-093718ff-ce13-4b89-ab95-1389dbbba0ba'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:03.117807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb295ed9b83e4133a0448712b533ea54', 'request_id': 'req-093718ff-ce13-4b89-ab95-1389dbbba0ba'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:03.124531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb295ed9b83e4133a0448712b533ea54', 'request_id': 'req-093718ff-ce13-4b89-ab95-1389dbbba0ba'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:03.141153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] The token cache is being invalidate because project eb295ed9b83e4133a0448712b533ea54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:03.141440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:03.142085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-093718ff-ce13-4b89-ab95-1389dbbba0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:03.143611 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1315/2667] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:03 2022] DELETE /identity/v3/projects/eb295ed9b83e4133a0448712b533ea54 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:03.148363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.148649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.148922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.167876 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:03.169065 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:03.202642 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:03.229995 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1353/2668] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:03.238728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.239008 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.239309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.258685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:03.259897 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:03.268190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1316/2669] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:03.272215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.281911 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86a192-bfb6-4215-a711-37b7178b8450 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.286479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.287078 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.287389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.287661 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.288306 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:03.288608 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.290189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.301932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1354/2670] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:03.306166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.315895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab0af2-5209-44aa-bdaa-8ac8259fed2a None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.320525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.321107 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.321381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.321647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.322266 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.324203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.329183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:03.353125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1317/2671] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:03 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:03.357673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.368176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16500d06-f22a-4753-bb54-5e4e449cd398 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.432387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.432989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.433263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.433525 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.434135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.436601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.458183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1355/2672] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:03 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:03.462575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.472607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c7df5-63f1-43eb-8469-1db80f57103d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.477130 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.477714 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.477987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.478254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.478885 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.480499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.490857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1318/2673] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:03.495008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.505817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ece42-e316-445a-a168-ff31fe710325 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.510538 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.511213 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.511621 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.511907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.512530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.514137 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64572658-4f6f-4565-9eb8-558b43eb50d0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.524669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1356/2674] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:03.528798 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.538600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33210d2-570f-4b74-bf50-0579b5ad5f30 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.543196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.543853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.544127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.544927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] PATH_INFO: `/v3/projects/c784bdc989fc4985a5a72715fd8c1709/users/7304de0bf74e42bca44e9ab7d082fe22/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.561181 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784bdc989fc4985a5a72715fd8c1709, user_id=7304de0bf74e42bca44e9ab7d082fe22, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.563853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.576474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1319/2675] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:03 2022] PUT /identity/v3/projects/c784bdc989fc4985a5a72715fd8c1709/users/7304de0bf74e42bca44e9ab7d082fe22/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:03.587729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.588094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.588434 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.620994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] MFA Rules not processed for user `7304de0bf74e42bca44e9ab7d082fe22`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:03.622201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:03.692131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1357/2676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:03.700617 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:03.702539 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:03.761748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4e9eb-1046-4232-abbd-bea3e9f9ce49 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:03.765386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:03.765983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:03.766257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:03.766522 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:03.775297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:03.776728 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ecfd-a11b-4b97-ba91-82ae44dc9875 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:03.786013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1320/2677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:04.300687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:04.302131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:04.358278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:04.400047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ada6-0734-4130-8645-ed923c810383 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:04.406875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:04.407542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:04.407821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:04.408093 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:04.409981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:04.425111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:04.426950 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:04.452596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1358/2678] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:06.237961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:06.238464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:06.238575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:06.256837 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] MFA Rules not processed for user `7304de0bf74e42bca44e9ab7d082fe22`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:06.258036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:06.264623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1321/2679] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:08.061564 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:08.063004 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:08.131949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab538b7-3bdf-4865-8fa4-560fdca4132f service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:08.135773 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:08.136401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:08.136746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:08.137080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:08.139509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:08.205087 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:08.206534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:08.217823 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1359/2680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:11.373191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:11.375861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:11.396651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c7181-3278-4d90-8621-77ac29829eec None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:11.408659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:11.409377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:11.409669 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:11.409923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] PATH_INFO: `/v3/users/8dcb94f981244d569f1dd791a4d911ac` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:11.411196 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcb94f981244d569f1dd791a4d911ac)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:11.413390 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:11.465583 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcb94f981244d569f1dd791a4d911ac'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.473540 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcb94f981244d569f1dd791a4d911ac'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.480607 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcb94f981244d569f1dd791a4d911ac'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.493283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcb94f981244d569f1dd791a4d911ac'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.493944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-46b359b8-703c-4402-85ae-b6792f6999d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcb94f981244d569f1dd791a4d911ac'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.500007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1322/2681] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:11 2022] DELETE /identity/v3/users/8dcb94f981244d569f1dd791a4d911ac => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:11.708889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:11.723333 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c16c87-0333-42a0-8756-0c122f0a4dc0 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:11.783495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:11.784127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:11.784402 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:11.784671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] PATH_INFO: `/v3/projects/a301a9f453aa435dbd07ff1d074e5a08` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:11.785777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a301a9f453aa435dbd07ff1d074e5a08)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:11.787759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:11.802369 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:11.848154 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a301a9f453aa435dbd07ff1d074e5a08', 'request_id': 'req-404c0a63-440b-47cb-9f19-3ee342c2390d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.853472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a301a9f453aa435dbd07ff1d074e5a08', 'request_id': 'req-404c0a63-440b-47cb-9f19-3ee342c2390d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.860158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a301a9f453aa435dbd07ff1d074e5a08', 'request_id': 'req-404c0a63-440b-47cb-9f19-3ee342c2390d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.874473 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] The token cache is being invalidate because project a301a9f453aa435dbd07ff1d074e5a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:11.874824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.875570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-404c0a63-440b-47cb-9f19-3ee342c2390d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:11.877092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1360/2682] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:11 2022] DELETE /identity/v3/projects/a301a9f453aa435dbd07ff1d074e5a08 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:11.882297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:11.882452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:11.882627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:11.901767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:11.902949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:11.914865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:11.965192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1323/2683] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:11.976907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:11.977194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:11.977468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:11.998357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:11.999657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:12.007616 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1361/2684] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:12.011912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.021745 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7fc0b-d75c-4054-a002-ef9a77464287 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.026575 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.027175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.027552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.027825 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.028975 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:12.029277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.030884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.042479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1324/2685] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:12.047469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.058226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedfa5-dbaa-4278-8894-4ec5f10df67f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.062889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.063601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.063880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.064143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.064776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.066659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.095510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1362/2686] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:12.099757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.111017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d6754-b3ab-4c51-907b-bdf914c704c5 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.167201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.167836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.168111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.168376 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.169718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.171985 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.193180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1325/2687] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:12 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:12.197271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.208171 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ca4d-b426-41b3-bf73-2380d67ea15e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.213003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.213596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.213872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.214138 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.214765 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.217002 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.230875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1363/2688] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:49:12.232647 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.242804 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213efb5-2f39-4469-a595-192dcf907a5e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.247425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.248017 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.248288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.248551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.249205 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.250767 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36f3db-f6dc-47fa-96ab-c689c34a708c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.261361 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1326/2689] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:12.265587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.275613 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1d4d4-e837-4dd6-ba0f-fa4c8e3f0f8f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.281036 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.281687 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.281968 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.282242 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] PATH_INFO: `/v3/projects/540421f4336f4cf5a754a57703f68a0c/users/79160a56705945c9a96b83d4c979a959/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.297446 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=540421f4336f4cf5a754a57703f68a0c, user_id=79160a56705945c9a96b83d4c979a959, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.300199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.312872 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1364/2690] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:12 2022] PUT /identity/v3/projects/540421f4336f4cf5a754a57703f68a0c/users/79160a56705945c9a96b83d4c979a959/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:12.324434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.324803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.325169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.353099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] MFA Rules not processed for user `79160a56705945c9a96b83d4c979a959`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:12.354315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:12.427351 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1327/2691] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:12.440309 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:12.442210 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:12.524893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e31d58-e6c6-410a-a590-67960cd612fc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:12.531344 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:12.532047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:12.532390 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:12.532725 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:12.541383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:12.543073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26d5e-eb5c-461c-a5bb-3f8448da40c3 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:12.552806 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1365/2692] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:22.423930 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:22.548438 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:24.153688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:24.223484 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fc12a-599e-42db-8498-9a851e1a68e1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:24.228004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:24.228627 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:24.228905 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:24.229174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] PATH_INFO: `/v3/users/79160a56705945c9a96b83d4c979a959` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:24.230309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79160a56705945c9a96b83d4c979a959)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:24.232283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:24.284065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79160a56705945c9a96b83d4c979a959'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.292532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79160a56705945c9a96b83d4c979a959'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.300319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79160a56705945c9a96b83d4c979a959'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.315844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79160a56705945c9a96b83d4c979a959'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.317036 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79160a56705945c9a96b83d4c979a959'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.324247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1328/2693] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:24 2022] DELETE /identity/v3/users/79160a56705945c9a96b83d4c979a959 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:24.329399 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:24.329922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:24.329922 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:24.351307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:24.352512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:24.410160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1366/2694] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:24.420718 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:24.422212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:24.481232 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d984e0-86ad-43b0-864c-0e6ea59d9119 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:24.485487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:24.486094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:24.486368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:24.486636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:24.496250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:24.500031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b288e-7aa4-420f-b391-517908affb50 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:24.510038 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1329/2695] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:24.869753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:24.871291 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:24.884041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04aad2-7eff-47e9-b623-f554ec1fda1b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:24.888638 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:24.889268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:24.889541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:24.889810 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] PATH_INFO: `/v3/projects/540421f4336f4cf5a754a57703f68a0c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:24.890967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540421f4336f4cf5a754a57703f68a0c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:24.892892 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:24.940315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540421f4336f4cf5a754a57703f68a0c', 'request_id': 'req-6db7271c-ec86-4b19-a2a3-b26d689ef162'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.945660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540421f4336f4cf5a754a57703f68a0c', 'request_id': 'req-6db7271c-ec86-4b19-a2a3-b26d689ef162'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.952460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540421f4336f4cf5a754a57703f68a0c', 'request_id': 'req-6db7271c-ec86-4b19-a2a3-b26d689ef162'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.964655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] The token cache is being invalidate because project 540421f4336f4cf5a754a57703f68a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:24.964943 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.965571 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6db7271c-ec86-4b19-a2a3-b26d689ef162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:24.967582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1367/2696] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:24 2022] DELETE /identity/v3/projects/540421f4336f4cf5a754a57703f68a0c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:24.972524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:24.972808 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:24.973079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:24.992388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:24.993562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:25.011303 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:25.057782 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1330/2697] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:25.065576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.065865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.066141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.085394 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:25.086852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:25.095227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1368/2698] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:25.099287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.109309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba3248-f325-4110-9291-f661a6e647d2 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.113829 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.114413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.114761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.114964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.115628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:25.115929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.117487 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.128591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1331/2699] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:25.132509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.142118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f0556-f883-410c-aae8-4fbf9213a1c2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.146775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.147391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.147671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.147944 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.148598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.150472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.180216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1369/2700] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:25.181385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.191289 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7678d5-7185-4a4f-b9bc-821dcc2a28d4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.247119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.247738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.248013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.248288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.248889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.250765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.271710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1332/2701] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:25.275830 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.286719 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717901f-decf-4a00-b8de-ff42b94f3698 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.291232 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.291843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.292117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.292385 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.293011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.294671 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.306094 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1370/2702] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:25.310024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.320281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17829e-dc8e-40ac-b6af-23176263dbaa admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.324931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.325520 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.326291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.326562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.327220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.328838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4f9f8-bc3b-42a6-acdd-d456b22ad222 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.339513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1333/2703] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:25.344225 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.354198 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c471a7-110a-43c8-8274-9288b405bdd7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.358729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.359406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.359690 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.359961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] PATH_INFO: `/v3/projects/1515e137c3c24a69a6241d1ac151a500/users/5bd2987625814b398ee3510a03119f27/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.373966 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1515e137c3c24a69a6241d1ac151a500, user_id=5bd2987625814b398ee3510a03119f27, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.376629 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.389650 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1371/2704] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:25 2022] PUT /identity/v3/projects/1515e137c3c24a69a6241d1ac151a500/users/5bd2987625814b398ee3510a03119f27/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:25.400987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.401362 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.401724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.429685 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] MFA Rules not processed for user `5bd2987625814b398ee3510a03119f27`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:25.430879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:25.493432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1334/2705] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:25.498294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.519849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:25.561076 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d3517-7344-42f0-b8be-d214e5f613a7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.565824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.566447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.566722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.567021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.567673 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.569577 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.603552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1372/2706] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:25.607752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.618257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c53f5-ce66-44d4-aa2b-1b87d32faf11 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.630882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:25.674708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.675338 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.675646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.675918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.676529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.678424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.702034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1335/2707] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:25.706041 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.719544 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb3dd2-7e4f-4fc9-91fe-88dfc1f7c098 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.724298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.724919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.725209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.725461 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.726089 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.727796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.742570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1373/2708] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:49:25.743807 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.754220 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e2577-90c9-4f77-b812-fab6b26dfc76 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.758755 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.759377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.759651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.759916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.760550 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.762114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7b378-4ea9-4457-af52-30df0ab359c3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.774780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1336/2709] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:25.779767 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:25.789896 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f990bb-387d-46bc-8e98-c241d6d3601d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:25.794599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:25.795267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.795554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.795825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] PATH_INFO: `/v3/projects/b5560f631ef54c98a7cfbbe34bdd0cb5/users/2201771fa5594fa8bcbb3df63614d3eb/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.811270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5560f631ef54c98a7cfbbe34bdd0cb5, user_id=2201771fa5594fa8bcbb3df63614d3eb, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:25.813907 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:25.827189 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1374/2710] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:25 2022] PUT /identity/v3/projects/b5560f631ef54c98a7cfbbe34bdd0cb5/users/2201771fa5594fa8bcbb3df63614d3eb/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:25.838563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:25.838843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:25.839110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:25.866224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] MFA Rules not processed for user `2201771fa5594fa8bcbb3df63614d3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:25.867429 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:25.930972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1337/2711] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:25.936297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.008168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bbc2d-c490-429f-9356-5ac773e2a877 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.013142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.013746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.014022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.014297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.014967 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.016919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.042497 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1375/2712] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:25 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:26.047164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.058123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2778b-6647-4615-9f20-b9a825aa60ad None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.114916 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.115555 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.115831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.116096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.116701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.118672 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.139194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1338/2713] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:26 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:26.143167 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.153383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86b82-7015-4d12-9fd1-15a8eaeca267 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.157984 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.158572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.158851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.159122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.159796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.161375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.172802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1376/2714] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:26.176697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.186906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008111ae-1ffe-4396-8d0d-2ef050a1aab4 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.191427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.192057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.192330 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.192597 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] PATH_INFO: `/v3/projects/134778b2b0ab46ffa4d1ddea359f5772/users/f025efdc74e6467f80a307daecdbd59b/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.204127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:26.207557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134778b2b0ab46ffa4d1ddea359f5772, user_id=f025efdc74e6467f80a307daecdbd59b, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.211577 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.224244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1339/2715] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:26 2022] PUT /identity/v3/projects/134778b2b0ab46ffa4d1ddea359f5772/users/f025efdc74e6467f80a307daecdbd59b/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:26.228098 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.238535 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed71606-cef9-43b9-8db4-1be5fe2133cd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.279843 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:26.296114 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.296711 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.296989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.297254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.297880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.299533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23651bb4-038f-48f0-9b58-06e4380cc36a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.308994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1377/2716] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:26.313224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.323382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617a365-54d0-402a-82fc-22de69dfc362 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.327977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.328616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.328894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.329166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] PATH_INFO: `/v3/projects/134778b2b0ab46ffa4d1ddea359f5772/users/f025efdc74e6467f80a307daecdbd59b/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.331070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134778b2b0ab46ffa4d1ddea359f5772, user_id=f025efdc74e6467f80a307daecdbd59b, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.333720 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.345934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1340/2717] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:26 2022] PUT /identity/v3/projects/134778b2b0ab46ffa4d1ddea359f5772/users/f025efdc74e6467f80a307daecdbd59b/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:26.355888 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.356366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.356480 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.383706 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] MFA Rules not processed for user `f025efdc74e6467f80a307daecdbd59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:26.384900 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:26.452357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1378/2718] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:26.462998 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:26.464704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:26.521125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc323b-3506-4cf0-9388-04160ccfea46 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:26.524753 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:26.525340 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:26.525615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:26.525880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:26.535090 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:26.536479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26898c-f7fc-48e2-bad4-f20310762b9c service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:26.546268 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1341/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:27.041800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:27.052596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d22d67-f1cd-40af-b330-78a3e662ae8c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:27.056188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:27.056901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:27.057052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:27.057348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:27.115860 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:27.117799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:27.126777 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1379/2720] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:32.049065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:32.049579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:32.049683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:32.068894 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:32.070110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:32.129949 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1342/2721] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:32.153566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:32.155276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:32.231782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d4c66-12d7-47de-8471-2bb0fe9b254a service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:32.237316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:32.238088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:32.238444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:32.238714 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:32.244030 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:32.248378 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:32.249260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:32.249785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:32.250961 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adbe41-4fda-4077-9730-49c58dc23d90 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:32.259947 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1380/2722] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:49:32.261510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673c226-6ce2-4a1d-8699-ee304ef48a65 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:32.266529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:32.267272 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:32.267637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:32.267978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:32.327886 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:32.329333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:32.339367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1343/2723] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:32.811026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98396c-9fe7-48ce-9737-353e3a6664f3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:32.811596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98396c-9fe7-48ce-9737-353e3a6664f3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:32.812080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98396c-9fe7-48ce-9737-353e3a6664f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:32.836271 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dd98396c-9fe7-48ce-9737-353e3a6664f3 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:32.837802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dd98396c-9fe7-48ce-9737-353e3a6664f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:32.846403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1381/2724] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:32.859129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:32.870744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea76f3-e661-46dd-8127-3e203d1326f1 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:32.875757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:32.876350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:32.876629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:32.876991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:32.885563 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:32.887128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:32.897024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1344/2725] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 20:49:33.127585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e54e-31ec-4256-8778-b79231098901 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:33.127873 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e54e-31ec-4256-8778-b79231098901 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:33.128148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00e54e-31ec-4256-8778-b79231098901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:33.148361 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5f00e54e-31ec-4256-8778-b79231098901 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:33.149737 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f00e54e-31ec-4256-8778-b79231098901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:33.157360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1382/2726] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:33.169171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:33.179908 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a748a8-7bed-4067-af24-287258fcbabf service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:33.185715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:33.186276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:33.186547 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:33.186813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:33.194838 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:33.196449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:33.199831 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:33.206590 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1345/2727] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:33.527173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:33.527496 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:33.527770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:33.546815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:33.548025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:33.555056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1383/2728] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:33.566612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:33.577392 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcb513-eb57-4455-96ca-afb67acd7372 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:33.582349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:33.582933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:33.583206 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:33.583498 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:33.592409 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:33.593942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762349a6-2679-4ada-b949-08234b2d43e2 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:33.602061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1346/2729] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:33.873474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:33.874887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:33.942886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ffc7a-7896-4022-9dc4-08ff1636d2b2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:33.949728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:33.951278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:33.951278 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:33.951493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] PATH_INFO: `/v3/users/6ee98b0b2658465ead382cb97eb8ae93` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:33.952652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee98b0b2658465ead382cb97eb8ae93)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:33.954733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:34.133233 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee98b0b2658465ead382cb97eb8ae93'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.141387 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee98b0b2658465ead382cb97eb8ae93'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.151104 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee98b0b2658465ead382cb97eb8ae93'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.151741 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee98b0b2658465ead382cb97eb8ae93'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.164511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee98b0b2658465ead382cb97eb8ae93'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.177501 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1384/2730] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:33 2022] DELETE /identity/v3/users/6ee98b0b2658465ead382cb97eb8ae93 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:34.179704 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.180167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.180294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.200098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:34.201368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.272155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1347/2731] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:34.282575 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:34.284314 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.354704 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e6765-47d9-4523-b0c4-0b78a9d4625c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:34.359982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:34.360595 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.360869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.361136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.368356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:34.370941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:34.373492 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d5028-e6fd-4047-a504-a2f866d68adc service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:34.387760 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1385/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:34.529424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:34.531302 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.544708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1199d5e-25a9-4901-8778-c81e3f1b5c57 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:34.550226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:34.551044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.551589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.551958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] PATH_INFO: `/v3/users/5bd2987625814b398ee3510a03119f27` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.553312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd2987625814b398ee3510a03119f27)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:34.555420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:34.626686 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd2987625814b398ee3510a03119f27'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.637309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd2987625814b398ee3510a03119f27'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.649087 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd2987625814b398ee3510a03119f27'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.665864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd2987625814b398ee3510a03119f27'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.666814 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd2987625814b398ee3510a03119f27'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.675791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1348/2733] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:34 2022] DELETE /identity/v3/users/5bd2987625814b398ee3510a03119f27 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:34.680195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.680470 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.680924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.702422 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:34.703651 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.717054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:34.718589 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.793603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1386/2734] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:34.803842 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:34.805276 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:34.805408 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.809355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c69fc-2d9c-4147-beee-f979fd6a387f admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:34.817928 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:34.820103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.820401 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.820738 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] PATH_INFO: `/v3/projects/90bc5215aca5438a9e7363934e49eb6b` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.822503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bc5215aca5438a9e7363934e49eb6b)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:34.824477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:34.876158 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a9a63-0119-4b58-8cb1-e9886f2e7b4c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:34.882384 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bc5215aca5438a9e7363934e49eb6b', 'request_id': 'req-409a42c8-d22a-4db5-b651-7eec1991ccf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.890320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bc5215aca5438a9e7363934e49eb6b', 'request_id': 'req-409a42c8-d22a-4db5-b651-7eec1991ccf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.897924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bc5215aca5438a9e7363934e49eb6b', 'request_id': 'req-409a42c8-d22a-4db5-b651-7eec1991ccf8'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.911984 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] The token cache is being invalidate because project 90bc5215aca5438a9e7363934e49eb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:34.912287 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.913157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-409a42c8-d22a-4db5-b651-7eec1991ccf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:34.914834 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1349/2735] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:34 2022] DELETE /identity/v3/projects/90bc5215aca5438a9e7363934e49eb6b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:34.920403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1392-0a72-428e-9684-9c9ef1122534 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.920746 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1392-0a72-428e-9684-9c9ef1122534 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.920997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1392-0a72-428e-9684-9c9ef1122534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.935562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:34.936168 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:34.936445 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:34.936716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:34.938463 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:34.940457 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-20af1392-0a72-428e-9684-9c9ef1122534 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:34.941622 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-20af1392-0a72-428e-9684-9c9ef1122534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.003211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1350/2736] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:35.008177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.009666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.011407 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.011696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.011988 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.019563 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1387/2737] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:35.032295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:35.033490 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.041446 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1351/2738] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:35.046341 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.051978 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:35.058824 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035688f-c328-4be2-9dd7-d4ca214ad174 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.065238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.065839 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.066115 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.066413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.067149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:35.067530 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.069215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.083401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1388/2739] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:35.088186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.097904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb89fdc-4325-4e92-8ce8-86f05851def4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.103541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.104186 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.104631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.104900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.105562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.108045 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.137900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1352/2740] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:35 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:35.142449 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.154121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d17908-6580-4147-8d30-acc8aa50c6d5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.217588 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.218173 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.218275 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.218532 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.219870 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.221996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.250794 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1389/2741] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:35 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:35.252164 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.264001 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119e6f-22c4-42ad-9410-4f454b672201 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.270028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.270859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.271368 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.271884 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.272592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.274503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.286462 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1353/2742] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:35.291224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.297939 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.299725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.304234 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c35e1-5417-492e-a2ab-f2bd2d1454d9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.310109 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.310721 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.311047 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.311415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.311901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.313488 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.313836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f860a-29df-4661-9ca1-9dbb9ea3823e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.319379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.320298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.320573 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.320841 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] PATH_INFO: `/v3/projects/1515e137c3c24a69a6241d1ac151a500` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.324370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1515e137c3c24a69a6241d1ac151a500)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.325321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1390/2743] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:35.328125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.329460 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.341409 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ccc35-1e92-4066-a9b1-ef1146b24edd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.346269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.346921 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.347197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.347505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] PATH_INFO: `/v3/projects/018934fef0f0449aa106919333cf9d1e/users/fdeed99b63844142981d0e8ce3afc850/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.363761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018934fef0f0449aa106919333cf9d1e, user_id=fdeed99b63844142981d0e8ce3afc850, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.366411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4ab62-6523-43f6-b43e-88b11db62600 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.375101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:35.379675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1515e137c3c24a69a6241d1ac151a500', 'request_id': 'req-62b6ee32-b661-4338-aadc-f8ce40c9d10d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.380657 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1391/2744] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:35 2022] PUT /identity/v3/projects/018934fef0f0449aa106919333cf9d1e/users/fdeed99b63844142981d0e8ce3afc850/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:35.385712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.385996 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.386269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.386473 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1515e137c3c24a69a6241d1ac151a500', 'request_id': 'req-62b6ee32-b661-4338-aadc-f8ce40c9d10d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.395793 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1515e137c3c24a69a6241d1ac151a500', 'request_id': 'req-62b6ee32-b661-4338-aadc-f8ce40c9d10d'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.406828 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:35.408292 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.409155 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] The token cache is being invalidate because project 1515e137c3c24a69a6241d1ac151a500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:35.409441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.410058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.411693 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1354/2745] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:35 2022] DELETE /identity/v3/projects/1515e137c3c24a69a6241d1ac151a500 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:35.415857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.417382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.471793 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1392/2746] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:35.481274 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.481436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6ee32-b661-4338-aadc-f8ce40c9d10d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.483315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.486763 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.487412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.487691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.487966 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] PATH_INFO: `/v3/users/2201771fa5594fa8bcbb3df63614d3eb` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.489085 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2201771fa5594fa8bcbb3df63614d3eb)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.490972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.530655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:35.539095 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2201771fa5594fa8bcbb3df63614d3eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.543069 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0750f-a1ed-4462-9191-1b4bbf2e61f8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.547512 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2201771fa5594fa8bcbb3df63614d3eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.547768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.548376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.548656 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.548923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.554780 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2201771fa5594fa8bcbb3df63614d3eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.559891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.561322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.567914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2201771fa5594fa8bcbb3df63614d3eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.568621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2201771fa5594fa8bcbb3df63614d3eb'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:35.571131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1393/2747] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:35.574649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1355/2748] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:35 2022] DELETE /identity/v3/users/2201771fa5594fa8bcbb3df63614d3eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:35.856347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.869443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d898f-86a9-44fd-b263-801620fbdbab service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.940095 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.940738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.941007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.941273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] PATH_INFO: `/v3/projects/b5560f631ef54c98a7cfbbe34bdd0cb5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.942410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5560f631ef54c98a7cfbbe34bdd0cb5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.944340 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:35.949101 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:35.951178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:35.970880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3212310-b7d6-4c9a-89fa-c18bab93622c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:35.977880 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:35.978277 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:35.978690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:35.978967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] PATH_INFO: `/v3/users/7304de0bf74e42bca44e9ab7d082fe22` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:35.980530 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7304de0bf74e42bca44e9ab7d082fe22)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:35.982677 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:36.009481 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5560f631ef54c98a7cfbbe34bdd0cb5', 'request_id': 'req-6f9ce055-0f34-4662-952e-7807cbf491e7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.017316 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5560f631ef54c98a7cfbbe34bdd0cb5', 'request_id': 'req-6f9ce055-0f34-4662-952e-7807cbf491e7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.024919 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5560f631ef54c98a7cfbbe34bdd0cb5', 'request_id': 'req-6f9ce055-0f34-4662-952e-7807cbf491e7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.038864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:36.042971 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7304de0bf74e42bca44e9ab7d082fe22'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.043222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] The token cache is being invalidate because project b5560f631ef54c98a7cfbbe34bdd0cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:36.043542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.044252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.045756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1394/2749] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:35 2022] DELETE /identity/v3/projects/b5560f631ef54c98a7cfbbe34bdd0cb5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:36.050301 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:36.051862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:36.053874 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7304de0bf74e42bca44e9ab7d082fe22'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.062912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7304de0bf74e42bca44e9ab7d082fe22'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.078931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7304de0bf74e42bca44e9ab7d082fe22'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.080016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-db58dda5-3a64-4a20-bf1f-30ed009ec8ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7304de0bf74e42bca44e9ab7d082fe22'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.089029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1356/2750] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:35 2022] DELETE /identity/v3/users/7304de0bf74e42bca44e9ab7d082fe22 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:36.093300 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:36.093861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:36.094227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:36.117153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:36.118579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:36.135821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ce055-0f34-4662-952e-7807cbf491e7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:36.164521 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:36.207171 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1357/2751] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:36.215377 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:36.216593 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:36.216865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:36.217130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] PATH_INFO: `/v3/users/f025efdc74e6467f80a307daecdbd59b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:36.217828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:36.218305 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f025efdc74e6467f80a307daecdbd59b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:36.220469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:36.221436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:36.292197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f025efdc74e6467f80a307daecdbd59b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.294661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac630-3960-4a1a-a9a0-6ea9ef830d01 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:36.303271 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:36.303526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f025efdc74e6467f80a307daecdbd59b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.303912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:36.304193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:36.304464 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:36.316025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f025efdc74e6467f80a307daecdbd59b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.316734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f025efdc74e6467f80a307daecdbd59b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.319364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:36.321664 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:36.336238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f025efdc74e6467f80a307daecdbd59b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.340293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1358/2752] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:36.349136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1395/2753] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:36 2022] DELETE /identity/v3/users/f025efdc74e6467f80a307daecdbd59b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:36.665915 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:36.668218 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:36.688527 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702985dd-017e-4d00-ac31-23f691212780 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:36.782333 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:36.783177 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:36.783546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:36.783875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] PATH_INFO: `/v3/projects/c784bdc989fc4985a5a72715fd8c1709` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:36.785501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c784bdc989fc4985a5a72715fd8c1709)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:36.787273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:36.798449 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:36.863355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c784bdc989fc4985a5a72715fd8c1709', 'request_id': 'req-85c753eb-bc94-465b-a446-c70d97083620'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.874425 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c784bdc989fc4985a5a72715fd8c1709', 'request_id': 'req-85c753eb-bc94-465b-a446-c70d97083620'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.882360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c784bdc989fc4985a5a72715fd8c1709', 'request_id': 'req-85c753eb-bc94-465b-a446-c70d97083620'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.896194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] The token cache is being invalidate because project c784bdc989fc4985a5a72715fd8c1709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:36.896542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.897281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-85c753eb-bc94-465b-a446-c70d97083620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:36.898850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1359/2754] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:36 2022] DELETE /identity/v3/projects/c784bdc989fc4985a5a72715fd8c1709 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:36.912378 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:36.915786 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:36.950118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1af0-a056-4219-9184-99dcd6855a51 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.082111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.083208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.083605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.083945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] PATH_INFO: `/v3/projects/134778b2b0ab46ffa4d1ddea359f5772` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.085262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=134778b2b0ab46ffa4d1ddea359f5772)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.087814 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.147181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:37.152085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134778b2b0ab46ffa4d1ddea359f5772', 'request_id': 'req-9bdddbff-d389-4ae7-9504-73894c196f50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:37.161169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134778b2b0ab46ffa4d1ddea359f5772', 'request_id': 'req-9bdddbff-d389-4ae7-9504-73894c196f50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:37.169007 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134778b2b0ab46ffa4d1ddea359f5772', 'request_id': 'req-9bdddbff-d389-4ae7-9504-73894c196f50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:37.183753 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] The token cache is being invalidate because project 134778b2b0ab46ffa4d1ddea359f5772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:37.184039 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:37.184716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9bdddbff-d389-4ae7-9504-73894c196f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:37.191091 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1396/2755] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:36 2022] DELETE /identity/v3/projects/134778b2b0ab46ffa4d1ddea359f5772 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:37.192748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.193311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.193311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.218761 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:37.220070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:37.316396 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1360/2756] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:37.325949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.326465 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.326548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.352174 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:37.353558 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:37.366687 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.371334 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1397/2757] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:37.379288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2d882-6ea0-4f7f-b648-970757552bc1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.384327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.384938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.385211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.385692 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.386336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:37.386631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.388787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.401432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1361/2758] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:37.406598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.417186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a53a9-2f86-49b3-adfe-56c2ab8fd8b8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.422815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.423565 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.423849 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.424117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.424758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.426663 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.461363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1398/2759] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:37.465319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.476019 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ea37-050e-4d0d-ac75-4552f097eea0 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.538743 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.539291 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.539580 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.540274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.540488 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.542440 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.563875 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1362/2760] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:37.568003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.579141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc6a4f-1565-4bc8-83cb-9dd1173325c0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.588669 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.589545 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.589826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.590097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.590749 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.592639 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.606090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1399/2761] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:49:37.610189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.620426 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf86b4-12d6-4d9f-975b-0a2aa58ed505 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.626201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.626828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.627103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.627404 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.628049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.629623 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b3f14-12f9-4f5d-83a7-9a6b7d0165ae admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.643015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1363/2762] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:37.647265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.657197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66596c0c-194a-40db-aad1-fce2c4056fb2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.662317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.662869 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.663144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.663534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] PATH_INFO: `/v3/projects/93621ce6989c40fd94deb7a9d82af1ef/users/e33902946090452c964cc541c4dd3e28/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.680782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93621ce6989c40fd94deb7a9d82af1ef, user_id=e33902946090452c964cc541c4dd3e28, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.683928 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:37.701862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1400/2763] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:37 2022] PUT /identity/v3/projects/93621ce6989c40fd94deb7a9d82af1ef/users/e33902946090452c964cc541c4dd3e28/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:37.713451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.713727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.714020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.721883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:37.749438 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] MFA Rules not processed for user `e33902946090452c964cc541c4dd3e28`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:37.750784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:37.869524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1364/2764] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:37.874181 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:37.978317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd17d26-0f85-448e-bca3-de8f86685902 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:37.984917 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:37.991298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:37.991298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:37.991298 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:37.992331 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:37.999150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.048250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1401/2765] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:37 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:38.052453 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.066513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df98de-7ba2-4ae3-9dde-b4d243cdc7d4 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.193293 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.193904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.194346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.194827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.195902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.197846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.239796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.240606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1365/2766] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:38 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:38.256160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045c1e9-24f4-47ea-88f9-9b15c1ec410d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.263553 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.265778 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.266357 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.266866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.267800 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.271149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.289124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1402/2767] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:38.294835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.308844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f71e-1485-49f6-85fe-2c5a8e644fe7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.313891 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.314574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.314860 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.315855 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] PATH_INFO: `/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5/users/ba8807047f3f403b9872852e1213eac1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.342167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b3b3dc3cf54deab952992fe8e842b5, user_id=ba8807047f3f403b9872852e1213eac1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.346350 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.375381 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1366/2768] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:38 2022] PUT /identity/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5/users/ba8807047f3f403b9872852e1213eac1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:38.379131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.391084 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea1216-7429-4a18-bf62-e064c4a5d1c1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.476988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:38.495572 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.496705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.496981 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.497302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.497953 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.499615 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b77d9-4030-4e61-a3bf-d561371b100b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.534454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.535038 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1403/2769] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:38.545937 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7e26a-1df6-4e3c-8a2c-97f9c3296731 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.561625 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.562345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.562688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.563028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] PATH_INFO: `/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5/users/ba8807047f3f403b9872852e1213eac1/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.570416 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b3b3dc3cf54deab952992fe8e842b5, user_id=ba8807047f3f403b9872852e1213eac1, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.573570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.597341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1367/2770] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:38 2022] PUT /identity/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5/users/ba8807047f3f403b9872852e1213eac1/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:38.609569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.610190 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.610658 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.661393 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] MFA Rules not processed for user `ba8807047f3f403b9872852e1213eac1`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:38.662871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:38.775381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1404/2771] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:38.788734 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:38.790549 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:38.856110 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:38.873961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3834b-fd83-42f1-aba7-b084b42bdb6d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:38.886252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:38.886878 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:38.887166 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:38.887469 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:38.899935 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:38.901868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c58c7-5fb9-40f9-a422-687a8851b0ff service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:38.914242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1368/2772] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:39.662046 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:39.739923 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dee9a3-73cf-40c3-a60f-d3e1d42f676f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:39.745307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:39.746462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:39.746748 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:39.747770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] PATH_INFO: `/v3/users/e33902946090452c964cc541c4dd3e28` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:39.748960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33902946090452c964cc541c4dd3e28)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:39.750994 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:39.820140 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33902946090452c964cc541c4dd3e28'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:39.830413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33902946090452c964cc541c4dd3e28'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:39.844993 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33902946090452c964cc541c4dd3e28'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:39.847738 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33902946090452c964cc541c4dd3e28'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:39.859740 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:39.867537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33902946090452c964cc541c4dd3e28'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:39.876856 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1405/2773] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:39 2022] DELETE /identity/v3/users/e33902946090452c964cc541c4dd3e28 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:39.881284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d6db-901c-45e0-be84-f79d7498c835 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:39.881794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d6db-901c-45e0-be84-f79d7498c835 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:39.881794 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7d6db-901c-45e0-be84-f79d7498c835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:39.918346 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-1fb7d6db-901c-45e0-be84-f79d7498c835 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:39.919791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1fb7d6db-901c-45e0-be84-f79d7498c835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.035403 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1369/2774] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:40.042372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.044945 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.135781 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05afbf-b6f2-4cae-9ce3-37f3293d9075 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.140787 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.141570 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.141851 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.142124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.154192 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.155752 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.175396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1406/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:40.443708 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.443986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.444252 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.477175 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] MFA Rules not processed for user `fdeed99b63844142981d0e8ce3afc850`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:40.478413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.546624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.548489 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.562908 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1370/2776] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:40.563537 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65655a3a-f8c4-42e5-b9b5-58e54b6c955e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.567557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.568739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.568972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.569425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.569757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.570088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] PATH_INFO: `/v3/projects/93621ce6989c40fd94deb7a9d82af1ef` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.571170 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93621ce6989c40fd94deb7a9d82af1ef)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.573494 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.591510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f6b79-cfc4-4612-b140-701b1cb78e50 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.606139 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.607535 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.607817 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.608194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.608713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.610612 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.643178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1371/2777] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:40 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:40.646589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93621ce6989c40fd94deb7a9d82af1ef', 'request_id': 'req-88b42a21-1751-4296-8c3d-6006b5415bd9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.647467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.654574 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93621ce6989c40fd94deb7a9d82af1ef', 'request_id': 'req-88b42a21-1751-4296-8c3d-6006b5415bd9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.662551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93621ce6989c40fd94deb7a9d82af1ef', 'request_id': 'req-88b42a21-1751-4296-8c3d-6006b5415bd9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.676376 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] The token cache is being invalidate because project 93621ce6989c40fd94deb7a9d82af1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:40.676670 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.677317 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.679218 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1407/2778] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:40 2022] DELETE /identity/v3/projects/93621ce6989c40fd94deb7a9d82af1ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:40.682974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.684380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.719470 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:40.733420 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd9a30-8c2e-4317-ae39-228f5a5c488d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.738410 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.739025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.739325 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.739649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.740270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.742283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.771670 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1372/2779] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:40 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:40.771897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b42a21-1751-4296-8c3d-6006b5415bd9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.772760 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.773812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.774380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.774520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.774736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.774930 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] PATH_INFO: `/v3/users/ba8807047f3f403b9872852e1213eac1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.776321 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8807047f3f403b9872852e1213eac1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.778762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.789757 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e8b90-3a9e-4ed0-a363-ba5b2fa5ca69 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.793881 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:40.795562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.796170 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.796447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.796845 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.797493 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.799069 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.809696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1373/2780] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:40.814134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.824413 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5cf31-cc00-4836-9802-d1f1f2064740 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.828993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.829659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.829952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.830192 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] PATH_INFO: `/v3/projects/402609d659224384a783c944cc6a08da/users/285cad7429ef45bca8a92779951db517/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.832052 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8807047f3f403b9872852e1213eac1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.839630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8807047f3f403b9872852e1213eac1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.846179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=402609d659224384a783c944cc6a08da, user_id=285cad7429ef45bca8a92779951db517, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.847973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8807047f3f403b9872852e1213eac1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.848653 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8807047f3f403b9872852e1213eac1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.848983 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:40.861716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8807047f3f403b9872852e1213eac1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:40.862265 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1374/2781] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:40 2022] PUT /identity/v3/projects/402609d659224384a783c944cc6a08da/users/285cad7429ef45bca8a92779951db517/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:40.865832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:40.867513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:40.867899 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1408/2782] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:40 2022] DELETE /identity/v3/users/ba8807047f3f403b9872852e1213eac1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:40.932942 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f312fb-941a-46be-ba1c-18fc9a1be46e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:40.994355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:40.995494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:40.995494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:40.995683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:40.996254 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:40.997877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.009601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1375/2783] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:49:41.016498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.030550 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07169e8-c3dc-42f0-9051-015d2f6d3f83 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.036260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.036929 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.037209 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.037479 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] PATH_INFO: `/v3/projects/402609d659224384a783c944cc6a08da/users/285cad7429ef45bca8a92779951db517/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.039518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=402609d659224384a783c944cc6a08da, user_id=285cad7429ef45bca8a92779951db517, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.042130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c65a8-92c4-4636-88e6-c0c824d3c18d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.053043 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1409/2784] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:41 2022] PUT /identity/v3/projects/402609d659224384a783c944cc6a08da/users/285cad7429ef45bca8a92779951db517/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:41.152256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.154756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:41.168111 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06f808-4759-44e8-bbbd-d3bd72be720e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.226531 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:41.250193 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.250876 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.251207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.251510 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] PATH_INFO: `/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.252712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b3b3dc3cf54deab952992fe8e842b5)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.254668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.306033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b3b3dc3cf54deab952992fe8e842b5', 'request_id': 'req-4afd30c0-03f5-45e8-9656-4eb29583a80f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:41.315661 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b3b3dc3cf54deab952992fe8e842b5', 'request_id': 'req-4afd30c0-03f5-45e8-9656-4eb29583a80f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:41.326153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b3b3dc3cf54deab952992fe8e842b5', 'request_id': 'req-4afd30c0-03f5-45e8-9656-4eb29583a80f'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:41.344591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] The token cache is being invalidate because project c0b3b3dc3cf54deab952992fe8e842b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:41.344912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:41.345532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4afd30c0-03f5-45e8-9656-4eb29583a80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:41.351501 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1376/2785] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:41 2022] DELETE /identity/v3/projects/c0b3b3dc3cf54deab952992fe8e842b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:41.353450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.353736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.354003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.383625 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:41.384891 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:41.462326 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1410/2786] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:41.470191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.470537 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.470766 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.492127 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:41.493356 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:41.502694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1377/2787] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:41.506769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.524199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ae30a-2ef9-4dd7-aa3c-67a23705e8b4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.529389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.530200 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.530474 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.530739 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.531427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:41.531729 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.533425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.546323 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1411/2788] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:49:41.550717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.561049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb84bd-fc5e-492d-97b0-41a8c8c7eb10 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.565822 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.566427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.566701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.566995 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.567660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.569631 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.627200 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1378/2789] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:41.628404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.639825 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825c8-56ba-4a3d-af1a-a0a3a0af2352 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.701276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.701932 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.702042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.702366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.703003 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.704925 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.718699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:41.742180 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.749779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1412/2790] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:49:41.754128 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913b3b1-cbee-4159-b830-fa11f8960a53 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.759201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.759839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.760114 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.760379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.761016 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.762703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.778311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1379/2791] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:41.782221 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.805587 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b93855-91a5-478a-87b6-32214610c0c9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.821389 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.822264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.823152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.823555 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.824498 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.826273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77fe5a-61f0-4a55-b4cd-3f6d3ae2710a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.843780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1413/2792] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:41.845079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:41.855694 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed3a6b-5be5-4db9-8b13-2f99d8a8a56e admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:41.866691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:41.867502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.867904 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.868182 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] PATH_INFO: `/v3/projects/0a36b204403b48f8b16cb593016e2987/users/3cd3b2faf58e47e1ac36f8c5e1890054/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.887929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a36b204403b48f8b16cb593016e2987, user_id=3cd3b2faf58e47e1ac36f8c5e1890054, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:41.891228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:41.905906 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1380/2793] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:41 2022] PUT /identity/v3/projects/0a36b204403b48f8b16cb593016e2987/users/3cd3b2faf58e47e1ac36f8c5e1890054/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:41.916664 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:41.917196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:41.917536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:41.952598 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] MFA Rules not processed for user `3cd3b2faf58e47e1ac36f8c5e1890054`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:41.954312 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:42.036018 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1414/2794] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:49:42.050123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:42.054211 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:42.120666 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced18f17-9e74-4f17-91cb-fa7888c8eaf2 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:42.124572 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:42.125262 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:42.125606 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:42.125936 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:42.136866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:42.138443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20fd23-2dd2-4fc5-a017-e08a4e3a6010 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:42.147993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1381/2795] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:42.168121 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:42.249949 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e435e7-53fe-4c2e-9726-18d06bb8e2d0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:42.256072 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:42.256551 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:42.256846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:42.257139 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] PATH_INFO: `/v3/users/3cd3b2faf58e47e1ac36f8c5e1890054` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:42.258722 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd3b2faf58e47e1ac36f8c5e1890054)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:42.261484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:42.334294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd3b2faf58e47e1ac36f8c5e1890054'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:42.344822 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd3b2faf58e47e1ac36f8c5e1890054'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:42.358155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd3b2faf58e47e1ac36f8c5e1890054'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:42.358886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd3b2faf58e47e1ac36f8c5e1890054'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:42.371581 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:42.377308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd3b2faf58e47e1ac36f8c5e1890054'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:42.388330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1415/2796] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:49:42 2022] DELETE /identity/v3/users/3cd3b2faf58e47e1ac36f8c5e1890054 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:42.390027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:42.390318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:42.390592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:42.410402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:42.411644 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:42.434337 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:42.486621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1382/2797] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:42.496513 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:42.498022 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:42.569539 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8e7d2-9a59-4488-aa0a-b7dbc588653c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:42.574330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:42.574951 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:42.575844 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:42.576117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:42.592797 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:42.596034 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc587c-3a4b-4b47-8ade-e1e185e874a9 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:42.610447 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1416/2798] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:43.076345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.078864 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:43.102153 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c14730-6433-429a-9a17-35a3c6fcc50f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.109027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.110178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.110651 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.110978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] PATH_INFO: `/v3/projects/0a36b204403b48f8b16cb593016e2987` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.112723 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a36b204403b48f8b16cb593016e2987)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.114690 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.194601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a36b204403b48f8b16cb593016e2987', 'request_id': 'req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:43.201311 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a36b204403b48f8b16cb593016e2987', 'request_id': 'req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:43.207671 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a36b204403b48f8b16cb593016e2987', 'request_id': 'req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:43.226406 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] The token cache is being invalidate because project 0a36b204403b48f8b16cb593016e2987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:49:43.228668 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:43.229424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ddfe58f4-ec72-48e3-9ab5-52d222a68b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:49:43.231969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1383/2799] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:49:43 2022] DELETE /identity/v3/projects/0a36b204403b48f8b16cb593016e2987 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:49:43.237336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.237948 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.238064 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.263335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:43.264569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:43.334962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1417/2800] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:43.401890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.402377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.402758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.443025 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:43.444030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:43.452832 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1384/2801] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:43.456927 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.469081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abba40-0c68-4eca-96a0-14d4ef79486c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.479339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.481779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.482285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.482882 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.483817 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:49:43.484322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.486762 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.508197 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1418/2802] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:49:43.512754 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.525578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc2de8-7fe1-474d-802e-aae0224cefd1 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.533367 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.534057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.534414 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.534748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.535471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.537430 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.583697 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1385/2803] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:49:43 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:43.586307 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.600120 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d6e8e-698e-4e72-a858-2ed6ad293ccc admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.679858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.680486 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.680764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.681035 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.681742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.690511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.730113 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.732889 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1419/2804] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:49:43 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:49:43.743730 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dfd55a-8a0f-41f2-ba2b-6c4826ce804d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.756195 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.756844 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.757191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.757379 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.760460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.762319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.820167 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1386/2805] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 20:49:43.822268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.835612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f2e8d-a243-4cd1-866f-945e10d5dd96 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.846846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.848430 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.849482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.849962 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.850895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.854262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c5ec3-f0eb-4e9a-b6a7-8337a5dc726e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.868503 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:43.892810 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:43.895063 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1420/2806] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:49:43.905524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29deb5c4-ed8b-4649-b879-df64246880bc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:43.927219 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:43.928918 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.929861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.930297 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] PATH_INFO: `/v3/projects/5dd9765fc4d94035be92f776a3875d31/users/4b2eaff87f144957bc635804f250fe9c/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:43.948326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd9765fc4d94035be92f776a3875d31, user_id=4b2eaff87f144957bc635804f250fe9c, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:43.951635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:43.983108 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1387/2807] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:49:43 2022] PUT /identity/v3/projects/5dd9765fc4d94035be92f776a3875d31/users/4b2eaff87f144957bc635804f250fe9c/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 20:49:43.994562 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5b7-7177-467a-a9c3-ec3c4514eb89 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:43.994853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5b7-7177-467a-a9c3-ec3c4514eb89 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:43.995131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193e5b7-7177-467a-a9c3-ec3c4514eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:44.049680 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3193e5b7-7177-467a-a9c3-ec3c4514eb89 None None] MFA Rules not processed for user `4b2eaff87f144957bc635804f250fe9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:44.051079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3193e5b7-7177-467a-a9c3-ec3c4514eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:44.140726 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1421/2808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:44.149021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:44.151024 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:44.202900 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:44.267503 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f1370-ea72-4ead-8ebf-8d0fd675efcc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:44.271683 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:44.272570 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:44.272849 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:44.275533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:44.295538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:44.297258 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:44.307967 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1388/2809] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:46.309129 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d34cf-c7dd-49f1-ae2f-807d6c1fc1f8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:46.310186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d34cf-c7dd-49f1-ae2f-807d6c1fc1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:46.310288 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d34cf-c7dd-49f1-ae2f-807d6c1fc1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:46.341630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-181d34cf-c7dd-49f1-ae2f-807d6c1fc1f8 None None] MFA Rules not processed for user `285cad7429ef45bca8a92779951db517`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:46.342222 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-181d34cf-c7dd-49f1-ae2f-807d6c1fc1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:46.456260 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1422/2810] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:46.469922 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:46.482524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d29b2-70d8-43da-a201-aea2be2c778c service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:46.486331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '165e5c1de12b448d92f5563e600bda2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:46.486929 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:46.487207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:46.487511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:46.490083 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:46.567525 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:46.569382 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:46.590187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1389/2811] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:46.753037 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:46.753322 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:46.753591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:46.776906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:46.778668 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:46.847761 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1423/2812] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:46.860298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:46.861819 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:46.933315 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38311-bde6-4082-a99d-809ec4796550 service glance] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:46.938482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:46.939152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:46.939724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:46.939999 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:46.949542 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:46.951868 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:46.961096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1390/2813] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:49:53.733347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:53.734811 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:53.777215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:53.849666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af810-df6a-4cec-b847-965b07d8b89d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:53.853482 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:53.854199 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:53.854484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:53.854754 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:53.857102 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:53.867511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:53.869027 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d196e5-df03-4548-8755-d2d70617469a service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:53.896085 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1424/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:49:53.968721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:53.982600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4530-8979-4f2f-bb71-aba1034ed155 service swift] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:53.987011 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:53.987748 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:53.988104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:53.988436 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:53.990256 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:54.053684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:49:54.078850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:54.080348 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:54.093513 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1391/2815] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:56.273395 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f377e9-0086-4989-a465-569ff0c65485 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:56.273859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f377e9-0086-4989-a465-569ff0c65485 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:56.273859 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f377e9-0086-4989-a465-569ff0c65485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:56.296347 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-87f377e9-0086-4989-a465-569ff0c65485 None None] MFA Rules not processed for user `fdeed99b63844142981d0e8ce3afc850`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:56.297699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87f377e9-0086-4989-a465-569ff0c65485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:56.304898 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1425/2816] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:49:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:56.576324 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:56.577816 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:56.589092 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ea478-2021-4c84-b2a8-f4b6a6b74d2c service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:56.593184 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:56.593776 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:56.594048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:56.594312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:56.595996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:56.605541 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:56.607648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:56.615526 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1392/2817] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:49:59.242973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:59.243493 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:59.243596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:59.262444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:49:59.264216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:49:59.271511 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1426/2818] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:49:59.284104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:49:59.296400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740074a-581a-4065-8703-ebe3b1648fab service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:49:59.301432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:49:59.301968 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:49:59.302247 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:49:59.302518 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:49:59.311097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:49:59.312682 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63608-9ace-4fcc-a28e-5c03787d23f0 service swift] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:49:59.321039 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1393/2819] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:49:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:50:07.953731 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.015456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8ed8b-b23c-4600-8e87-ecfb95bd9914 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.019983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.020605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.020883 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.021156 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] PATH_INFO: `/v3/users/4b2eaff87f144957bc635804f250fe9c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.022270 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2eaff87f144957bc635804f250fe9c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.024238 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:08.068500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2eaff87f144957bc635804f250fe9c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.075226 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2eaff87f144957bc635804f250fe9c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.083005 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2eaff87f144957bc635804f250fe9c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.083646 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2eaff87f144957bc635804f250fe9c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.096522 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2eaff87f144957bc635804f250fe9c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.102267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1427/2820] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:50:07 2022] DELETE /identity/v3/users/4b2eaff87f144957bc635804f250fe9c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:08.106675 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.107187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.107310 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.126255 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:08.127545 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:08.185306 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1394/2821] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:08.195679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.197184 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:08.231015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:08.258871 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83594d69-004c-4931-bffe-f3ca577fff50 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.262559 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.263152 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.263450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.263712 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.279040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.282413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0db4cd-f82f-4498-b5ec-2b1a258d7d16 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:08.311053 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1428/2822] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:08.575456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.579274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:08.597859 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf5c8-41d9-4fc6-8f6c-460123d93eea None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.611031 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.611705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.624275 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.624584 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] PATH_INFO: `/v3/projects/5dd9765fc4d94035be92f776a3875d31` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.625901 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd9765fc4d94035be92f776a3875d31)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.627898 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:08.682634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd9765fc4d94035be92f776a3875d31', 'request_id': 'req-22a3cb88-427e-40d2-bb7b-3aa006b565d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.689427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd9765fc4d94035be92f776a3875d31', 'request_id': 'req-22a3cb88-427e-40d2-bb7b-3aa006b565d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.695688 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd9765fc4d94035be92f776a3875d31', 'request_id': 'req-22a3cb88-427e-40d2-bb7b-3aa006b565d0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.708432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] The token cache is being invalidate because project 5dd9765fc4d94035be92f776a3875d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:50:08.708715 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.709320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-22a3cb88-427e-40d2-bb7b-3aa006b565d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:08.711021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1395/2823] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:50:08 2022] DELETE /identity/v3/projects/5dd9765fc4d94035be92f776a3875d31 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:08.715779 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.716056 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.716324 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.735561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:08.736733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:08.794339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1429/2824] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:08.802174 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.802479 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.802756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.821854 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:08.823049 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:08.831428 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1396/2825] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:08.835443 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.845802 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246b6a-0ea7-4c89-9452-d207830107b4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.850303 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.850884 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.851160 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.851462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.852123 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:50:08.852420 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.853988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:08.865186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1430/2826] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:50:08.869393 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.878421 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f31b42-6e0e-4b73-bec7-43849d49cc43 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.883294 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.883877 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.884154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.884422 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.885035 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.886911 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:08.914068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1397/2827] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:50:08 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:50:08.918208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:08.928254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f2d62-4a47-4c02-b754-4a3343255cfb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:08.990477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:08.991083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:08.991458 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:08.991840 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:08.992468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:08.994466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.016015 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1431/2828] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:50:08 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:50:09.020096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.030342 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bff0c-0029-4d2f-8e15-abbafc3a7b6c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.034933 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.035552 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.035828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.036093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.036724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.038295 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.039521 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:09.049742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1398/2829] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:50:09.053088 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.063450 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca1ed7-e914-4293-903a-88059f14c356 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.068077 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.068659 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.068938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.069212 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.069845 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.071468 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba97a48-d325-4ca4-a3fb-b9449b14d46a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.082201 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1432/2830] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:50:09.086847 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.096562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81a542-62a0-45f8-885e-b7e6e08c9f72 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.101099 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.101724 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.101996 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.102260 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] PATH_INFO: `/v3/projects/54d09f9c04434241b460836294e89fdd/users/14bad63e99114f999e271bb01eab8f9e/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.116261 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d09f9c04434241b460836294e89fdd, user_id=14bad63e99114f999e271bb01eab8f9e, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.118902 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.132805 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1399/2831] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:50:09 2022] PUT /identity/v3/projects/54d09f9c04434241b460836294e89fdd/users/14bad63e99114f999e271bb01eab8f9e/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:09.144774 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.145103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.145412 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.171987 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] MFA Rules not processed for user `14bad63e99114f999e271bb01eab8f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:09.173176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:09.199148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:09.242912 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1433/2832] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:09.254969 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.256852 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:09.314227 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51325af-8b09-459c-a905-beacc5542623 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.318093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.318701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.318978 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.319281 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.328451 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.329879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e7c96-45ed-4945-8834-3a27770e088a service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.339250 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1400/2833] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:09.363649 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.428517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d8436-63cd-47ea-a2ca-b152d305441f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.433131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.433756 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.434032 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.434302 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] PATH_INFO: `/v3/users/14bad63e99114f999e271bb01eab8f9e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.435459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bad63e99114f999e271bb01eab8f9e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.437910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.484662 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bad63e99114f999e271bb01eab8f9e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:09.492080 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bad63e99114f999e271bb01eab8f9e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:09.499775 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bad63e99114f999e271bb01eab8f9e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:09.500336 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bad63e99114f999e271bb01eab8f9e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:09.511858 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bad63e99114f999e271bb01eab8f9e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:09.517596 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1434/2834] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:50:09 2022] DELETE /identity/v3/users/14bad63e99114f999e271bb01eab8f9e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:09.522088 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.522370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.522636 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.540912 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:09.542098 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:09.603119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1401/2835] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:09.614141 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.615678 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:09.666652 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:09.673679 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117c6b-ba18-4e80-9c94-a7294499d94e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:09.678284 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:09.678880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:09.679155 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:09.679454 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:09.689391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:09.690804 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc4f5e-a72e-4a90-b813-2f2bdac0d0ad service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:09.700248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1435/2836] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:09.981119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:09.983460 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:09.996112 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b01b4-786b-4895-a26f-cbbd7b349464 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.000673 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.001298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.001574 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.001843 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] PATH_INFO: `/v3/projects/54d09f9c04434241b460836294e89fdd` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.002972 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d09f9c04434241b460836294e89fdd)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.004927 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.054102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d09f9c04434241b460836294e89fdd', 'request_id': 'req-be360ee0-b166-4cad-8e1e-93299817fec1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:10.059562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d09f9c04434241b460836294e89fdd', 'request_id': 'req-be360ee0-b166-4cad-8e1e-93299817fec1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:10.065582 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d09f9c04434241b460836294e89fdd', 'request_id': 'req-be360ee0-b166-4cad-8e1e-93299817fec1'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:10.073331 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:10.078948 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] The token cache is being invalidate because project 54d09f9c04434241b460836294e89fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:50:10.079483 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:10.080557 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-be360ee0-b166-4cad-8e1e-93299817fec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:10.082278 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1402/2837] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:50:09 2022] DELETE /identity/v3/projects/54d09f9c04434241b460836294e89fdd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:10.087604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.088175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.088175 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.107763 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:10.108960 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:10.166315 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1436/2838] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 20:50:10.173982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.174477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.174585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.193813 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:10.194982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:10.203388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1403/2839] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:10.207398 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.217769 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eed9d5-b578-45fe-823d-643535e284c7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.222215 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.222795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.223066 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.223368 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.224000 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:50:10.224294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.225854 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.237127 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1437/2840] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 20:50:10.241370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.251109 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a414e9-6d66-4365-928d-22e5b6d58074 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.256005 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.256609 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.256882 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.257148 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.257756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.259741 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.296964 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1404/2841] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:50:10 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:50:10.301248 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.311186 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53a68d-61c1-4c71-bdca-658e4ac66e9c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.366483 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.367101 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.367410 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.367677 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.368294 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.370206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.391855 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1438/2842] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:50:10 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:50:10.395836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.406463 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1b5c8-ef19-48fd-9f0c-2960b3e6bb82 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.410934 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.411554 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.411828 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.412093 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.412717 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.414285 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.424360 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1405/2843] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:50:10.428021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.438404 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813ab00-046c-4f35-9917-00bcc18b25a8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.443509 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.444097 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.444373 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.444641 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.445269 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.446841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75d1bd-8578-4d7f-a12c-2d2b1f5d0612 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.457818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1439/2844] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:50:10.462102 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.472157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd8a71-637a-456a-a5dc-9ea5e2489028 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.476784 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.477456 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.477736 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.478010 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] PATH_INFO: `/v3/projects/895d4829f9254c1f9d77f9eef4917124/users/d7fd14ad8df741b1acb189df4ca02b7c/roles/471bd621e24848afa89853237208e118` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.493314 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] RBAC: Authorizing `identity:create_grant(project_id=895d4829f9254c1f9d77f9eef4917124, user_id=d7fd14ad8df741b1acb189df4ca02b7c, role_id=471bd621e24848afa89853237208e118)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.496003 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.510635 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1406/2845] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:50:10 2022] PUT /identity/v3/projects/895d4829f9254c1f9d77f9eef4917124/users/d7fd14ad8df741b1acb189df4ca02b7c/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:10.522699 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23624-715c-4322-933a-0740d9473972 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.522983 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23624-715c-4322-933a-0740d9473972 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.523268 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b23624-715c-4322-933a-0740d9473972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.550850 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e8b23624-715c-4322-933a-0740d9473972 None None] MFA Rules not processed for user `d7fd14ad8df741b1acb189df4ca02b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:10.552194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e8b23624-715c-4322-933a-0740d9473972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:10.608348 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:10.632363 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1440/2846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:10.643168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:10.644993 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:10.703168 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76366dd-0997-435f-bdf7-6f78740f694a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:10.706758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:10.707386 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:10.707665 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:10.707931 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:10.716283 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:10.717695 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4328b6-858d-4dcf-86e6-7436a1c97de6 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:10.726326 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1407/2847] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:20.629008 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:20.722447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:34.139366 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b23624-715c-4322-933a-0740d9473972 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:34.200885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b23624-715c-4322-933a-0740d9473972 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:34.205441 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:34.206057 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:34.206335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:34.206605 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] PATH_INFO: `/v3/users/d7fd14ad8df741b1acb189df4ca02b7c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:34.207734 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fd14ad8df741b1acb189df4ca02b7c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:34.209630 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:34.254604 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fd14ad8df741b1acb189df4ca02b7c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.261384 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fd14ad8df741b1acb189df4ca02b7c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.267897 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fd14ad8df741b1acb189df4ca02b7c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.268601 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fd14ad8df741b1acb189df4ca02b7c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.280382 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fd14ad8df741b1acb189df4ca02b7c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.286227 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1441/2848] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:50:34 2022] DELETE /identity/v3/users/d7fd14ad8df741b1acb189df4ca02b7c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:34.290674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:34.291203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:34.291203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:34.311624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:50:34.312851 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:34.370616 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1408/2849] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:50:34.381081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:34.382500 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:34.450427 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeda8e-e169-4a7f-b52e-b8f290d8565e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:34.454025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:34.454622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:34.454901 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:34.455166 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:34.464187 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:34.465626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:34.475429 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1442/2850] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:34.736707 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:34.738178 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:34.751648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c10f9-7832-4a74-a905-48df9e35f446 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:34.757004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:34.757786 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:34.758068 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:34.758336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] PATH_INFO: `/v3/projects/895d4829f9254c1f9d77f9eef4917124` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:34.759576 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895d4829f9254c1f9d77f9eef4917124)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:34.761402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:34.808546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895d4829f9254c1f9d77f9eef4917124', 'request_id': 'req-57204460-de97-4c94-b4f1-bef08a842920'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.814116 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895d4829f9254c1f9d77f9eef4917124', 'request_id': 'req-57204460-de97-4c94-b4f1-bef08a842920'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.820524 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895d4829f9254c1f9d77f9eef4917124', 'request_id': 'req-57204460-de97-4c94-b4f1-bef08a842920'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.833072 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] The token cache is being invalidate because project 895d4829f9254c1f9d77f9eef4917124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:50:34.833355 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.833982 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:50:34.835474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1409/2851] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:50:34 2022] DELETE /identity/v3/projects/895d4829f9254c1f9d77f9eef4917124 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:50:41.548997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:50:41.557554 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d639b9-0556-45aa-91f6-671c064948f2 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:50:41.575561 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:41.608591 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:50:41.609194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:50:41.609469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:50:41.609735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:50:41.611536 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:50:41.672852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:50:41.674282 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:50:41.683718 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1443/2852] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:50:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:50:44.830074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:50:51.679485 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=40 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:51:37.284861 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:51:37.286257 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:51:37.354380 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204460-de97-4c94-b4f1-bef08a842920 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:51:37.360785 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:51:37.361388 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:51:37.361663 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:51:37.362569 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:51:37.364309 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:51:37.376358 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:51:37.377480 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:51:37.387394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1410/2853] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:51:47.383027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=32 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:04.154359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:04.155827 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:04.167122 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aca9b-2cee-4d2b-976e-08a88be67c43 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:04.170716 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:04.171337 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:04.171618 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:04.171887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:04.173512 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:04.231259 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:04.232681 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:04.242103 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1444/2854] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:52:08.954769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:08.956203 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:08.967684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9cf10-49e4-43df-8f2c-747d3bf790f3 service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:08.971157 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:08.971769 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:08.972044 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:08.972312 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:08.974452 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:09.035733 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:09.037097 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:09.046648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1411/2855] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:12.018239 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:12.032815 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e890e3-e634-4c12-a2f7-c6d13de59a51 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:12.038330 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:12.038886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:12.039162 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:12.039472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:12.041245 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:12.055985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:12.057626 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:12.076982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1445/2856] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:15.149491 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:15.151071 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:15.169865 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a41f47-5ca8-4afa-81b0-f79a16afe8fe service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:15.174511 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:15.175129 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:15.175437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:15.175705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] PATH_INFO: `/v3/users/1e651cfebd634d5cb2eb6df101c8ac84` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:15.176796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e651cfebd634d5cb2eb6df101c8ac84)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:15.179288 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:15.226385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e651cfebd634d5cb2eb6df101c8ac84'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.233236 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e651cfebd634d5cb2eb6df101c8ac84'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.241377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e651cfebd634d5cb2eb6df101c8ac84'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.253106 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e651cfebd634d5cb2eb6df101c8ac84'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.253764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e651cfebd634d5cb2eb6df101c8ac84'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.260133 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1412/2857] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:52:15 2022] DELETE /identity/v3/users/1e651cfebd634d5cb2eb6df101c8ac84 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:15.430846 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:15.441841 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b01e-32a5-488c-9091-cff3623d806c service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:15.499520 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:15.500143 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:15.500435 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:15.500708 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] PATH_INFO: `/v3/projects/74291027525f431293bb7c09c20dab12` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:15.501809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] RBAC: Authorizing `identity:delete_project(project_id=74291027525f431293bb7c09c20dab12)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:15.503736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:15.549074 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74291027525f431293bb7c09c20dab12', 'request_id': 'req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.554540 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74291027525f431293bb7c09c20dab12', 'request_id': 'req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.560602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74291027525f431293bb7c09c20dab12', 'request_id': 'req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.573426 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] The token cache is being invalidate because project 74291027525f431293bb7c09c20dab12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:52:15.573733 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.574375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.575878 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1446/2858] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:52:15 2022] DELETE /identity/v3/projects/74291027525f431293bb7c09c20dab12 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:15.579941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:15.582034 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:15.596136 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e70e2-6b11-4b4b-a5e5-6e43a0ce746d admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:15.656478 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:15.657023 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:15.657296 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:15.657562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] PATH_INFO: `/v3/users/ba38e9fd37af46c6ba4f7ab9602eda32` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:15.658662 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba38e9fd37af46c6ba4f7ab9602eda32)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:15.660585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:15.667126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:15.710336 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba38e9fd37af46c6ba4f7ab9602eda32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.717371 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba38e9fd37af46c6ba4f7ab9602eda32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.724443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba38e9fd37af46c6ba4f7ab9602eda32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.736103 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba38e9fd37af46c6ba4f7ab9602eda32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.736740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-4ed02bde-3481-44df-870e-e6669c28f6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba38e9fd37af46c6ba4f7ab9602eda32'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:15.742465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1413/2859] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:52:15 2022] DELETE /identity/v3/users/ba38e9fd37af46c6ba4f7ab9602eda32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:15.914196 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:15.915973 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:15.931526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0fed4-4e49-4b4f-8a7a-6162eecc43be admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:15.944505 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:15.997250 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:15.997875 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:15.998150 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:15.998418 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] PATH_INFO: `/v3/projects/0b0167c29bc54ed9832570deb5961965` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:15.999589 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0167c29bc54ed9832570deb5961965)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.001467 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.050432 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0167c29bc54ed9832570deb5961965', 'request_id': 'req-caf44c9c-b7a6-46ef-b00a-0773705c8c30'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:16.056339 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0167c29bc54ed9832570deb5961965', 'request_id': 'req-caf44c9c-b7a6-46ef-b00a-0773705c8c30'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:16.062240 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0167c29bc54ed9832570deb5961965', 'request_id': 'req-caf44c9c-b7a6-46ef-b00a-0773705c8c30'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:16.074768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] The token cache is being invalidate because project 0b0167c29bc54ed9832570deb5961965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:52:16.075050 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:16.075702 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-caf44c9c-b7a6-46ef-b00a-0773705c8c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:52:16.077195 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1447/2860] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:52:15 2022] DELETE /identity/v3/projects/0b0167c29bc54ed9832570deb5961965 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:16.082058 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.082345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.082615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.101739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:16.102923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:16.160224 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1414/2861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:16.168247 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.168528 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.168795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.188118 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:16.189283 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:16.197001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1448/2862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:16.200974 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.210377 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837d868-53e4-4f45-b98d-e0ca92ac762f None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.215120 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.215731 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.216004 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.216267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] PATH_INFO: `/v3/domains` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.216895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80187) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 20:52:16.217189 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.218752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.230349 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1415/2863] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 20:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 20:52:16.234285 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.244176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07b6a2-7efd-47eb-89bc-5c47cb90c640 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.248701 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.249272 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.249542 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.249803 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.250401 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.252386 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.278205 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1449/2864] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:52:16 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:52:16.282199 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.292400 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff3565-4795-4e96-a2c8-75019beaafca admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.346065 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.346646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.346923 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.347187 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.347827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.350209 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.371952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1416/2865] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:52:16 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:52:16.376068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.386216 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77f38d-e487-4bce-b7b7-d7a2cf01a2d5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.390818 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.391439 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.391723 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.391992 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.392620 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.394188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.403742 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1450/2866] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:52:16.407477 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.413443 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:16.419853 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe953fd-2242-4851-9f01-a121e3b24c4c admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.425191 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.425779 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.426057 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.426329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.427660 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.429364 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e54bb-521f-492d-b8bc-e8db87dfb24a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.440032 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1417/2867] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:52:16.444081 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.454534 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe274da-6ab7-4101-91d4-52ff89177177 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.459090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.459757 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.460040 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.460311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] PATH_INFO: `/v3/projects/dc14593c290f4d2fae5e08c99fcb7492/users/32e65710e03643e981b7e07be5201107/roles/471bd621e24848afa89853237208e118` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.475176 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc14593c290f4d2fae5e08c99fcb7492, user_id=32e65710e03643e981b7e07be5201107, role_id=471bd621e24848afa89853237208e118)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.477812 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.490764 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1451/2868] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:52:16 2022] PUT /identity/v3/projects/dc14593c290f4d2fae5e08c99fcb7492/users/32e65710e03643e981b7e07be5201107/roles/471bd621e24848afa89853237208e118 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:16.495710 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca18-02ad-4ce8-938c-481258ea9200 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.495990 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca18-02ad-4ce8-938c-481258ea9200 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.496282 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca18-02ad-4ce8-938c-481258ea9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.515850 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-33f8ca18-02ad-4ce8-938c-481258ea9200 None None] MFA Rules not processed for user `2fd914dd7cd747d0a7fae61653c493f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:16.517030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-33f8ca18-02ad-4ce8-938c-481258ea9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:16.574441 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1418/2869] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:16.584507 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:16.586459 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:16.631135 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:16.644982 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda433-7e77-4de5-83da-e039a34e6ab5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:16.649073 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:16.649666 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:16.649938 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:16.650224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:16.659020 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:16.660466 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:16.670380 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1452/2870] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:20.519950 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.520529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.520529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.550056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] MFA Rules not processed for user `32e65710e03643e981b7e07be5201107`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:20.551329 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:20.621991 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1419/2871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:20.626117 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.636808 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8781f-88e4-48db-ad28-c5613e0ace4e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.641499 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.642131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.642406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.642674 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.643367 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.645252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.675320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1453/2872] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 20:52:20 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 20:52:20.679585 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.690806 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ee8e9-ef21-4c88-9417-65edebe1c588 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.751056 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.751701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.751979 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.752248 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.752883 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.755402 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.778961 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1420/2873] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 20:52:20 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 20:52:20.783125 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.793893 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cae2e6-fb78-4244-b833-6f86ae9c57f1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.799042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.799693 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.799974 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.800267 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.800914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.802582 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.814308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1454/2874] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:52:20.819147 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.829624 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0a626-4440-42a3-b1a7-3603ee28c5a8 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.835022 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.835721 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.836305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.836586 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] PATH_INFO: `/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5/users/eac2c1effb7c41949c648897b76647ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.845713 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:20.854427 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=875ac23eb19d46dfb4bb3cc48d5aaee5, user_id=eac2c1effb7c41949c648897b76647ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.857762 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.871938 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1421/2875] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:52:20 2022] PUT /identity/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5/users/eac2c1effb7c41949c648897b76647ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:20.875956 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.886880 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec759c-efa6-43f9-8e0b-b50e305dca9a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.946887 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.947617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.947895 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.948179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.948826 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.950444 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d7e47-bd77-4ec0-a7e4-79104d829def admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.961820 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1455/2876] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 20:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 20:52:20.965943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:20.976405 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123597-8661-4663-a40a-bdb8403e6a6a admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:20.981009 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:20.981646 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:20.981924 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:20.982194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] PATH_INFO: `/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5/users/eac2c1effb7c41949c648897b76647ad/roles/fc8cdbed278f4649be4a0ebce40b55ee` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:20.984135 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=875ac23eb19d46dfb4bb3cc48d5aaee5, user_id=eac2c1effb7c41949c648897b76647ad, role_id=fc8cdbed278f4649be4a0ebce40b55ee)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:20.986752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:20.997532 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1422/2877] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 20:52:20 2022] PUT /identity/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5/users/eac2c1effb7c41949c648897b76647ad/roles/fc8cdbed278f4649be4a0ebce40b55ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:52:25.704759 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cde8-3ba3-42bb-ac6b-a263a1749f7e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:25.705265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cde8-3ba3-42bb-ac6b-a263a1749f7e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:25.705391 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cde8-3ba3-42bb-ac6b-a263a1749f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:25.736585 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5f63cde8-3ba3-42bb-ac6b-a263a1749f7e None None] MFA Rules not processed for user `eac2c1effb7c41949c648897b76647ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:25.737799 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f63cde8-3ba3-42bb-ac6b-a263a1749f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:25.812569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1456/2878] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:25.828732 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:25.830701 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:25.921475 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8deca30-043e-495f-b2f6-6ec32c87aefc admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:25.927394 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:25.928021 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:25.928298 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:25.928564 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:25.995437 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:25.997043 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:26.007956 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1423/2879] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:35.809403 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:36.002534 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:52:48.626955 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:48.627510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:48.627510 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:48.646100 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] MFA Rules not processed for user `32e65710e03643e981b7e07be5201107`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:52:48.647289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:48.654541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1457/2880] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:52:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:52:48.694231 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:48.696207 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:48.751943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5877f-2bad-443c-8fc8-ea7b28b7bedf service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:48.755505 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:48.756096 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:48.756373 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:48.756642 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:48.758953 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:48.771941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:48.773395 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:48.784134 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1424/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:49.062472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:49.063885 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:49.120169 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece42b-a479-4c3b-bc84-f482db2313b2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:49.123676 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:49.124273 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:49.124552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:49.124821 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:49.126519 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:49.135920 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:49.137335 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:49.145852 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1458/2882] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:49.587307 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:49.596648 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb703ee5-fb2e-4036-9053-42617195557b service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:49.600676 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:49.601320 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:49.602117 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:49.602471 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:49.604587 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:49.618363 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:49.619846 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:49.631124 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1425/2883] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:56.274518 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:56.283566 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f2987-de2f-40be-992e-9d532dc38065 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:56.287576 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:56.288179 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:56.288456 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:56.289425 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:56.290617 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:56.300776 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:56.302206 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:56.312985 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1459/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:52:57.423079 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:52:57.437244 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a704-fcf2-4807-a232-40e6c9f6a26e service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:52:57.443489 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:52:57.443684 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:52:57.443943 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:52:57.444214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:52:57.445986 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:52:57.459140 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:52:57.460739 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c91e7-a4a0-48a9-a6c3-e96518dd57c8 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:52:57.472228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1426/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:52:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:03.045705 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:03.060526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e34b6b-d53e-4610-a7c8-1d9bb6bf89dc service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:03.065988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:03.066586 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:03.066862 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:03.067202 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:03.068959 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:03.081788 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:03.083379 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:03.094548 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1460/2886] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 20:53:05.952318 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:05.952765 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:05.952873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:05.972650 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] MFA Rules not processed for user `3e6a6c8f45c84ebc9e9cfe1b32836e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:53:05.973835 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:06.026879 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1427/2887] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:53:06.066413 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:06.067836 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:06.135660 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039b2b-374e-4fd5-9547-fb2a7b167552 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:06.140406 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f493544ed09444499776046e5e36ec6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:06.141111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:06.141360 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:06.141622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:06.150526 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:06.152185 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:06.160411 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1461/2888] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 20:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 20:53:06.504152 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:06.515596 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eacfa-73e6-486b-a811-14179371a33e None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:06.519233 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:06.519944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:06.520284 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:06.520621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:06.530494 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:06.531952 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:06.541270 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1428/2889] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:53:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:53:12.718529 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:12.720194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:12.786383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2178089-a5ba-4dfe-a57b-3debb4027e4c service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:12.791644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:12.792265 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:12.792541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:12.792809 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] PATH_INFO: `/v3/users/fdeed99b63844142981d0e8ce3afc850` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:12.793914 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdeed99b63844142981d0e8ce3afc850)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:12.795865 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:12.797328 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:12.842371 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdeed99b63844142981d0e8ce3afc850'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:12.849281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdeed99b63844142981d0e8ce3afc850'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:12.856266 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdeed99b63844142981d0e8ce3afc850'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:12.857042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdeed99b63844142981d0e8ce3afc850'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:12.869346 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdeed99b63844142981d0e8ce3afc850'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:12.875068 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1462/2890] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:12 2022] DELETE /identity/v3/users/fdeed99b63844142981d0e8ce3afc850 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:13.047796 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:13.062601 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c83b0-7e3a-4508-8dfb-6f987a7ef014 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:13.121740 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:13.122344 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:13.122621 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:13.122889 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] PATH_INFO: `/v3/projects/018934fef0f0449aa106919333cf9d1e` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:13.124027 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=018934fef0f0449aa106919333cf9d1e)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:13.125895 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:13.136241 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=100 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:13.173591 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018934fef0f0449aa106919333cf9d1e', 'request_id': 'req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.178920 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018934fef0f0449aa106919333cf9d1e', 'request_id': 'req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.185013 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018934fef0f0449aa106919333cf9d1e', 'request_id': 'req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.196997 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] The token cache is being invalidate because project 018934fef0f0449aa106919333cf9d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:13.197279 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.197890 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.199370 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1429/2891] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:13 2022] DELETE /identity/v3/projects/018934fef0f0449aa106919333cf9d1e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:13.203325 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:13.204713 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:13.218254 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a60581-57b8-4948-b91b-0a9cc0e292ce admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:13.274356 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:13.274910 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:13.275428 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:13.275696 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] PATH_INFO: `/v3/users/285cad7429ef45bca8a92779951db517` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:13.282349 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285cad7429ef45bca8a92779951db517)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:13.284297 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:13.338177 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285cad7429ef45bca8a92779951db517'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.345029 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285cad7429ef45bca8a92779951db517'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.351768 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285cad7429ef45bca8a92779951db517'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.352396 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285cad7429ef45bca8a92779951db517'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.364021 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285cad7429ef45bca8a92779951db517'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.365569 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:13.370969 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1463/2892] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 20:53:13 2022] DELETE /identity/v3/users/285cad7429ef45bca8a92779951db517 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:13.544235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:53:13.545700 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:53:13.559047 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6a48a-bd6b-4661-a27b-a98a4c1bc2c9 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:53:13.624076 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:53:13.624699 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:53:13.624977 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:53:13.625267 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] PATH_INFO: `/v3/projects/402609d659224384a783c944cc6a08da` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:53:13.626454 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=402609d659224384a783c944cc6a08da)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:53:13.628385 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:53:13.673029 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402609d659224384a783c944cc6a08da', 'request_id': 'req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.678212 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402609d659224384a783c944cc6a08da', 'request_id': 'req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.684824 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402609d659224384a783c944cc6a08da', 'request_id': 'req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.698194 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] The token cache is being invalidate because project 402609d659224384a783c944cc6a08da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80187) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 20:53:13.698508 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.699126 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-8a0bf84b-0f71-4152-b6e0-e0aded32e6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 20:53:13.700628 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1430/2893] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 20:53:13 2022] DELETE /identity/v3/projects/402609d659224384a783c944cc6a08da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 20:53:23.375795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:53:23.694737 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:25.259092 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:25.260847 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.356655 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb91658-b049-4cef-be3e-334ad2c560f5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:25.436243 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:25.436866 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:25.437149 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:25.437423 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:25.439180 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:25.453131 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:25.454736 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:25.466622 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1464/2894] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:27.218054 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] REQUEST_METHOD: `POST` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.218560 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.218674 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.237637 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.auth.core [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] MFA Rules not processed for user `32e65710e03643e981b7e07be5201107`. Rule list: `[]` (Enabled: `True`). {{(pid=80187) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:55:27.238836 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.290944 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1431/2895] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:55:27.599462 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:27.601011 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.657142 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8df26-8140-4cb6-a545-3bceddae4a0e service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:27.661375 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:27.661975 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:27.662251 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:27.662517 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:27.664252 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:27.675320 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:27.676735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:27.684728 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1465/2896] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:29.125752 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:55:29.127185 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.195094 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bd4a7-9c2c-4d71-b631-047bd3b3b675 None None] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:55:29.200327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:55:29.200958 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:55:29.201235 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:55:29.201502 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:55:29.203209 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:55:29.215848 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:55:29.217432 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:55:29.228030 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1432/2897] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:55:37.681025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:55:39.223659 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=57 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:56:41.261188 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:56:41.262612 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:41.346112 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc8572-6ab2-4985-a5cc-5ac22aacd0c4 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:56:41.351144 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:56:41.351766 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:56:41.352042 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:56:41.352311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:56:41.353998 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:56:41.365603 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:56:41.367147 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133b0c9-7ed2-4230-9a28-179293dc4c86 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:56:41.377374 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1466/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:56:51.372709 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=37 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:39.207424 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:39.208809 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:39.312345 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2430f8-31b9-4d04-a71a-1f8080d6e03d service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:39.315987 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:39.316578 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:39.316857 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:39.317125 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:39.318833 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:39.329327 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:39.330719 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:39.339615 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1433/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:49.335423 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=48 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:57:50.333415 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.333972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.333972 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.354079 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] MFA Rules not processed for user `32e65710e03643e981b7e07be5201107`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 20:57:50.355281 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:50.361931 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1467/2900] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 20:57:50.402434 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:50.411634 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db042a-31bd-49ad-b122-2c7c4f2d622b service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:50.415154 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29f9cc8a29c4481491d319883cab7056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:50.415758 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.416033 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.416301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.417980 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:50.449201 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:50.450598 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:50.471893 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1434/2901] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:50.751599 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:50.771308 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c0a8e-007f-40a4-b7b5-776f1b7f5f7d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:50.774853 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:50.775477 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:50.775758 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:50.776025 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:50.777746 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:50.798936 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:50.800392 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:50.808359 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1468/2902] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:57:51.264941 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:57:51.275989 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c0be-3019-433e-8ac3-6677e4d08cf1 service cinder] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:57:51.279725 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:57:51.281007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:57:51.281357 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:57:51.281691 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:57:51.283579 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:57:51.300215 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:57:51.301705 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:57:51.315764 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1435/2903] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:00.804770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=18 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:01.309867 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=24 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:04.757782 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:04.759381 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:04.777289 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599457-e106-47c7-8ff5-3a3a6d40269e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:04.782751 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:04.783372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:04.783647 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:04.783913 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:04.785624 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:04.798257 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:04.799915 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:04.810556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1469/2904] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:05.089744 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:05.099074 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f586fd-b6ed-41ce-b476-a5a5347044e4 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:05.102696 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:05.103319 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:05.103600 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:05.103870 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:05.105594 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:05.115546 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:05.116955 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:05.124811 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1436/2905] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:07.974345 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:07.975795 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:07.987735 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b066-db91-4446-90a0-cf985090f5d4 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:07.991224 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:07.991835 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:07.992111 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:07.992383 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:07.994026 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:08.057343 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:08.058796 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:08.068183 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1470/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:09.580981 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 20:58:09.582408 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.598562 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32146474-1c1b-4ff5-af8b-b17c7b1a4702 service neutron] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 20:58:09.604190 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54e2221204ff4332ba980b9c5779b05c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 20:58:09.604791 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 20:58:09.605070 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 20:58:09.605341 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 20:58:09.607048 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 20:58:09.619862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 20:58:09.621772 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 20:58:09.633305 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1437/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 20:58:18.063963 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=36 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 20:58:19.628649 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=12 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:11.551472 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:11.560770 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84396143-9f1d-43c8-bca7-f4edc9010538 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:11.564400 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21d525a5c45e472e8e5f56d15b43df0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:11.564989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:11.565264 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:11.565533 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:11.567235 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:11.651469 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:11.652906 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:11.671106 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1471/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:14.672228 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:14.685301 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273fffd-bb1d-41d7-a37f-41165752b191 service nova] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:14.691015 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:14.692028 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:14.692482 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:14.693041 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:14.695412 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:14.715160 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:14.716789 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:14.727914 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1438/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:17.753286 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:17.768107 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544fec-42c7-4bcd-9eb0-0047b6d5b1d0 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:17.773495 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:17.774223 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:17.774602 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:17.774970 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:17.777364 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:17.790780 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:17.793727 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:17.805136 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1472/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 21:00:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:00:17.829474 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:17.831183 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:17.849529 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce883-4f11-4c9b-b0e1-06f088f825bb service placement] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:17.854839 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:17.855581 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:17.855866 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:17.856169 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] PATH_INFO: `/v3/users/32e65710e03643e981b7e07be5201107` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:17.857274 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e65710e03643e981b7e07be5201107)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:17.859179 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:17.909629 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e65710e03643e981b7e07be5201107'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:17.919061 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e65710e03643e981b7e07be5201107'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:17.926465 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e65710e03643e981b7e07be5201107'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:17.938803 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e65710e03643e981b7e07be5201107'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:17.939551 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e65710e03643e981b7e07be5201107'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:17.946273 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1439/2911] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 21:00:17 2022] DELETE /identity/v3/users/32e65710e03643e981b7e07be5201107 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:18.128001 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:18.145790 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5f76-9d74-493c-b289-52469f1cd9d4 service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:18.210010 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:18.210644 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.210924 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.211263 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] PATH_INFO: `/v3/projects/dc14593c290f4d2fae5e08c99fcb7492` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.212338 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc14593c290f4d2fae5e08c99fcb7492)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:18.215090 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:18.263194 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc14593c290f4d2fae5e08c99fcb7492', 'request_id': 'req-4dcdef97-1c85-4910-86e2-c025469c6de6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.266941 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:18.269372 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc14593c290f4d2fae5e08c99fcb7492', 'request_id': 'req-4dcdef97-1c85-4910-86e2-c025469c6de6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.277083 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc14593c290f4d2fae5e08c99fcb7492', 'request_id': 'req-4dcdef97-1c85-4910-86e2-c025469c6de6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.320256 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] The token cache is being invalidate because project dc14593c290f4d2fae5e08c99fcb7492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:00:18.320541 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.321148 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.323262 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1473/2912] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:18 2022] DELETE /identity/v3/projects/dc14593c290f4d2fae5e08c99fcb7492 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:18.327214 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:18.328703 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:18.341742 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ff76d-d16e-413f-b9d5-bf7d078beb81 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:18.396827 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:18.397447 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.397727 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.398007 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] PATH_INFO: `/v3/users/eac2c1effb7c41949c648897b76647ad` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.399119 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac2c1effb7c41949c648897b76647ad)` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:18.401073 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:18.446467 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac2c1effb7c41949c648897b76647ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.454945 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac2c1effb7c41949c648897b76647ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.460123 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:18.462242 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac2c1effb7c41949c648897b76647ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.476226 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac2c1effb7c41949c648897b76647ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.476873 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.notifications [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac2c1effb7c41949c648897b76647ad'} {{(pid=80187) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.482592 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1440/2913] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 21:00:18 2022] DELETE /identity/v3/users/eac2c1effb7c41949c648897b76647ad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 21:00:18.652614 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:00:18.654276 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:00:18.671124 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdef97-1c85-4910-86e2-c025469c6de6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:00:18.727311 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd914dd7cd747d0a7fae61653c493f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ec2c82e54624d69af0962b9e3a7a4d9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:00:18.727934 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:00:18.728208 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:00:18.728475 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] PATH_INFO: `/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:00:18.730082 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875ac23eb19d46dfb4bb3cc48d5aaee5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:00:18.731997 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:00:18.776130 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875ac23eb19d46dfb4bb3cc48d5aaee5', 'request_id': 'req-fb088922-f94a-4ade-8c04-1727ad292d99'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.781552 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875ac23eb19d46dfb4bb3cc48d5aaee5', 'request_id': 'req-fb088922-f94a-4ade-8c04-1727ad292d99'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.787484 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875ac23eb19d46dfb4bb3cc48d5aaee5', 'request_id': 'req-fb088922-f94a-4ade-8c04-1727ad292d99'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.800556 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] The token cache is being invalidate because project 875ac23eb19d46dfb4bb3cc48d5aaee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 21:00:18.800886 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.801514 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fb088922-f94a-4ade-8c04-1727ad292d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 21:00:18.802988 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1474/2914] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 21:00:18 2022] DELETE /identity/v3/projects/875ac23eb19d46dfb4bb3cc48d5aaee5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 21:00:28.479172 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:00:28.796989 dv-cinder-851996-5-iscsi devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 21:01:44.245104 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Authenticating user token {{(pid=80187) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 21:01:44.246533 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.313787 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d82ff-2e21-48ff-85e5-ad3d975d4ee7 admin admin] Validating token access rules against request {{(pid=80187) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 21:01:44.370862 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fd7f4118514807bc58c1e28523cdcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b1a1635b9b19476b9ba5686201da709f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80187) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 21:01:44.371538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] REQUEST_METHOD: `GET` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 21:01:44.371756 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] SCRIPT_NAME: `/identity` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 21:01:44.372020 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80187) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 21:01:44.373712 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.fernet_utils [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80187) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 21:01:44.384538 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 21:01:44.386080 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54010726-8d6f-4395-89a3-024b38e22c8f service placement] RBAC: Authorization granted {{(pid=80187) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 21:01:44.396735 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: [pid: 80187|app: 0|req: 1441/2915] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 21:01:54.391499 dv-cinder-851996-5-iscsi devstack@keystone.service[80187]: DEBUG dbcounter [-] [80187] Writing DB stats keystone:SELECT=58 {{(pid=80187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}